Jul 09 17:06:39.112771 ip-10-0-133-241 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 17:06:39.112785 ip-10-0-133-241 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 17:06:39.112795 ip-10-0-133-241 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 17:06:39.113249 ip-10-0-133-241 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 17:06:49.209035 ip-10-0-133-241 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 17:06:49.209053 ip-10-0-133-241 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c7d6df61ca0f4d769377cbb19f874e5a --
Jul 09 17:08:50.174145 ip-10-0-133-241 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 17:08:50.582322 ip-10-0-133-241 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:08:50.582322 ip-10-0-133-241 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 17:08:50.582322 ip-10-0-133-241 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:08:50.582322 ip-10-0-133-241 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 17:08:50.582322 ip-10-0-133-241 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:08:50.583002 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.582389    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 17:08:50.588792 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588769    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:08:50.588792 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588790    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:08:50.588792 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588794    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588798    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588803    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588806    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588821    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588824    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588827    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588832    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588836    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588847    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588851    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588854    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588856    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588859    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588862    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588864    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588867    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588869    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588872    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:08:50.588898 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588875    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588878    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588880    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588883    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588885    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588888    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588890    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588893    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588895    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588898    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588900    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588903    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588906    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588908    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588911    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588914    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588917    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588919    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588921    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588925    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:08:50.589332 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588927    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588930    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588932    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588935    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588938    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588940    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588942    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588945    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588947    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588950    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588953    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588955    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588959    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588962    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588968    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588971    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588974    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588977    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588980    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:08:50.590051 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588983    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588985    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588988    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588991    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588993    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588996    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.588998    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589001    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589003    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589006    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589008    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589010    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589013    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589015    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589018    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589020    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589023    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589026    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589028    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589031    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:08:50.590764 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589034    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589036    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589039    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589041    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589046    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589049    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589052    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589056    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589059    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589062    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589065    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589068    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589070    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589072    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589075    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589078    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589080    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589083    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.589085    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590896    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:08:50.591325 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590911    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590916    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590920    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590923    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590925    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590928    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590931    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590934    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590937    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590939    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590942    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590945    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590948    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590951    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590953    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590956    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590959    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590961    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590964    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590966    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:08:50.591803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590969    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590971    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590974    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590976    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590979    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590981    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590989    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590992    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590994    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590997    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.590999    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591002    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591005    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591008    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591011    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591013    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591016    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591018    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591021    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591024    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591026    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:08:50.592376 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591028    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591031    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591034    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591037    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591040    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591042    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591045    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591047    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591052    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591054    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591057    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591059    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591062    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591064    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591067    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591069    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591071    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591074    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591077    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:08:50.592924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591080    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591082    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591085    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591087    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591091    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591094    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591097    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591100    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591104    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591108    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591110    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591114    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591117    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591120    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591122    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591125    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591128    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591133    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591137    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:08:50.593364 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591140    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591143    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591146    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591150    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591153    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591156    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591159    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591161    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591164    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591168    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591171    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591174    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591177    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591179    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591182    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591185    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591187    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591190    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591193    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591604    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:08:50.593853 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591609    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591612    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591614    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591617    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591620    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591622    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591625    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591628    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591631    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591633    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591636    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591638    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591641    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591643    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591646    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591649    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591652    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591654    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591657    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591659    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:08:50.594337 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591662    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591665    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591669    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591673    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591676    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591679    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591682    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591685    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591687    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591690    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591692    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591694    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591697    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591700    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591703    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591705    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591707    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591710    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591713    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:08:50.594803 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591715    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591717    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591720    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591722    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591724    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591727    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591729    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591732    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591734    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591737    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591740    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591742    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591744    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591747    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591751    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591753    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591756    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591758    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591761    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591763    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:08:50.595387 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591766    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591769    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591771    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591774    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591776    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591779    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591781    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591784    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591787    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591789    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591792    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591794    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591796    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591799    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591801    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591804    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591807    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591825    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591828    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591831    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:08:50.595891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591834    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591836    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591839    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591843    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591846    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591849    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591852    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591855    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591858    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591861    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591863    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591867    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591870    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591873    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591875    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591878    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591882    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591886    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.591888    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.591961    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 17:08:50.596365 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.591969    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.591980    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.591987    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.591993    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.591998    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592004    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592010    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592014    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592017    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592021    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592024    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592028    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592031    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592034    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592037    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592040    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592043    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592048    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592052    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592055    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592058    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592062    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592070    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 17:08:50.596879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592073    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592077    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592080    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592083    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592086    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592089    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592092    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592095    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592099    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592102    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592110    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592114    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592117    2579 flags.go:64] FLAG: --enable-server="true"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592120    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592124    2579 flags.go:64] FLAG: --event-burst="100"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592127    2579 flags.go:64] FLAG: --event-qps="50"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592130    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592134    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592136    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592142    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592145    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592149    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592152    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592155    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592158    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 17:08:50.597416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592161    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592164    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592167    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592170    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592174    2579 flags.go:64] FLAG: --feature-gates=""
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592178    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592180    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592184    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592187    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592190    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592193    2579 flags.go:64] FLAG: --help="false"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592196    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592199    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592202    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592205    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592209    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592212    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592218    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592221    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592223    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592226    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592230    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592233    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592236    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 09 17:08:50.598041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592239    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592241    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592247    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592251    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592253    2579 flags.go:64] FLAG: --lock-file=""
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592256    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592259    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592262    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592269    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592272    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592275    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592278    2579 flags.go:64] FLAG: --logging-format="text"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592281    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592285    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592288    2579 flags.go:64] FLAG: --manifest-url=""
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592290    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592295    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592298    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592302    2579 flags.go:64] FLAG: --max-pods="110"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592305    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592308    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592311    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592314    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592317    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592321    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 17:08:50.598620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592325    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592333    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592336    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592340    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592343    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592346    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592352    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592355    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592358    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592361    2579 flags.go:64] FLAG: --port="10250"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592365    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592368    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07b980c40c0a77db4"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592371    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592375    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592378    2579 flags.go:64] FLAG: --register-node="true"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592381    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592385    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592390    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592393    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592397    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592400    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592403    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592407    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592410    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592412    2579 flags.go:64] FLAG: --runonce="false"
Jul 09 17:08:50.599250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592415    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592418    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592421    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592424    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592427    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592430    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592433    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592438    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592441    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592443    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592446    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592449    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592452    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592455    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592458    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592464    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592467    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592471    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592476    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592479    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592482    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592485    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592488    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592491    2579 flags.go:64] FLAG: --v="2"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592496    2579 flags.go:64] FLAG: --version="false"
Jul 09 17:08:50.599890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592500    2579 flags.go:64] FLAG: --vmodule=""
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592504    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.592508    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592633    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592637    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592640    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592643    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592647    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592649    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592652    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592655    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592658    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592660    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592663    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592667    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592670    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592672    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592675    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592678    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592680    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592683    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:08:50.600523 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592686    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592688    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592691    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592695    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592698    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592700    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592703    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592705    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592708    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592711    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592714    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592717    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592720    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592723    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592725    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592728    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592730    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592733    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592735    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592738    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:08:50.601046 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592740    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592743    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592745    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592748    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592750    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592754    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592757    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592759    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592762    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592765    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592767    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592771    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592775    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592778    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592781    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592785    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592788    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592791    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592793    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:08:50.601536 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592796    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592798    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592801    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592804    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592806    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592829    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592833    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592846    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592849    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592852    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592854    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592857    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592860    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592862    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592865    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592867    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592870    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592872    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592876    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:08:50.602048 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592879    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592882    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592884    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592887    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592889    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592892    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592894    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592897    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592900    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592904    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592906    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592909    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592911    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592914    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592916    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592919    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592922    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592924    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592929    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:08:50.602514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592932    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592937    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592941    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.592944    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.593555    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.600703    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.600723    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.600745    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.600751    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600826    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600833    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600836    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600839    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600842    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:08:50.602970 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600845    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600848    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600851    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600854    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600856    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600859    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600862    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600865    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600868    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600871    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600874    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600876    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600879    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600881    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600884    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600886    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600889    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600892    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600894    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600900    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:08:50.603326 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600903    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600905    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600908    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600911    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600915    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600918    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600921    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600923    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600926    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600929    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600932    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600935    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600937    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600940    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600942    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600945    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600950    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600953    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600956    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:08:50.603786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600959    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600961    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600964    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600967    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600969    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600972    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600974    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600977    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600979    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600982    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600985    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600987    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600990    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600994    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600996    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.600999    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601001    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601004    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601008    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:08:50.604270 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601012    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601015    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601018    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601021    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601024    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601026    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601029    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601032    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601036    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601039    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601042    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601045    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601048    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601051    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601054    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601057    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601060    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601063    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601066    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:08:50.604721 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601068    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601071    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601074    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601076    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601079    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601082    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601084    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601087    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601090    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601093    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601095    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601099    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601101    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601104    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601107    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601110    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:08:50.605182 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601112    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.601118    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601246    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601250    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601254    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601256    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601259    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601262    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601264    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601267    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601270    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601272    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601275    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601278    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601281    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:08:50.605596 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601283    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601286    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601289    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601293    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601296    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601299    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601302    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601305    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601307    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601310    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601314    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601317    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601320    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601322    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601325    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601327    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601330    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601333    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601336    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601338    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:08:50.605982 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601341    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601343    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601346    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601348    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601351    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601353    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601356    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601358    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601361    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601363    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601366    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601368    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601371    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601373    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601376    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601378    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601381    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601384    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601386    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601390    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:08:50.606454 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601393    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601395    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601398    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601401    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601405    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601407    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601410    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601412    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601415    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601417    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601420    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601424    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601427    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601439    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601443    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601446    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601449    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601451    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601454    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:08:50.606951 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601457    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601460    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601463    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601466    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601469    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601471    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601474    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601476    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601479    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601481    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601484    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601486    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601489    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601492    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601494    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601497    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601499    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601503    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601506    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:08:50.607404 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601509    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601511    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601514    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601516    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601519    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601522    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601524    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:50.601527    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.601532    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.601663    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.604060    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.605629    2579 server.go:1019] "Starting client certificate rotation"
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.605728    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 17:08:50.607877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.605771    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 17:08:50.608321 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.608303    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 17:08:50.610418 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.610402    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 17:08:50.623049 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.623021    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 09 17:08:50.625532 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.625509    2579 log.go:25] "Validated CRI v1 image API"
Jul 09 17:08:50.626773 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.626753    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 17:08:50.629209 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.629186    2579 fs.go:135] Filesystem UUIDs: map[573b8ebb-061d-4768-8351-8d5d544c2e5b:/dev/nvme0n1p4 6965e5e0-c729-4b74-9fb4-8ed19789e8cf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 17:08:50.629284 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.629207    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 17:08:50.636024 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.635856    2579 manager.go:216] Machine: {Timestamp:2026-07-09 17:08:50.634634134 +0000 UTC m=+0.341847071 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099909 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d461419ff4361a55a69764fbe6e58 SystemUUID:ec2d4614-19ff-4361-a55a-69764fbe6e58 BootID:c7d6df61-ca0f-4d76-9377-cbb19f874e5a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:ba:5c:93:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:ba:5c:93:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:23:7e:92:96:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 17:08:50.636024 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.636007    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 17:08:50.636205 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.636104    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 17:08:50.637351 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.637321    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 17:08:50.637536 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.637355    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 17:08:50.638320 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.638307    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 17:08:50.638388 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.638327    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 17:08:50.638388 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.638339    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 17:08:50.638584 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.638567    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 17:08:50.638994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.638981    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 17:08:50.640531 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.640519    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 17:08:50.643730 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.643716    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 17:08:50.643893 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.643881    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 17:08:50.643961 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.643923    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 17:08:50.643961 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.643946    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 17:08:50.644048 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.643967    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 17:08:50.644048 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.643980    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 09 17:08:50.644048 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.643994    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 17:08:50.644378 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.644364    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 17:08:50.644441 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.644386    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 17:08:50.646514 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.646497    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 17:08:50.648680 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.648666    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 17:08:50.648718 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.648698    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 17:08:50.648881 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.648871    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 17:08:50.648913 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.648887    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 17:08:50.648913 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.648894    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 17:08:50.648913 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.648899    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 17:08:50.648913 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.648908    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 17:08:50.648913 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.648914    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 17:08:50.649359 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.649350    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 17:08:50.649391 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.649361    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 17:08:50.649391 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.649371    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 17:08:50.649391 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.649379    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 17:08:50.649492 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.649401    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 17:08:50.649492 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.649414    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 17:08:50.650043 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.650030    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 17:08:50.650043 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.650040    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 17:08:50.653766 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.653585    2579 server.go:1268] "Started kubelet"
Jul 09 17:08:50.653864 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.653681    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 17:08:50.653864 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.653666    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 17:08:50.653864 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.653857    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 17:08:50.654646 ip-10-0-133-241 systemd[1]: Started Kubernetes Kubelet.
Jul 09 17:08:50.655187 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.655131    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 17:08:50.656398 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.656370    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 17:08:50.656970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.656951    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 17:08:50.657525 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.657499    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 17:08:50.657525 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.657500    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 17:08:50.660993 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.660968    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 17:08:50.661630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.661610    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 17:08:50.661630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.661627    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 17:08:50.661786 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.661681    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:50.662312 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662295    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 17:08:50.662312 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662299    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 17:08:50.662444 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662335    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 17:08:50.662487 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662468    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 17:08:50.662487 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662480    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 17:08:50.662617 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662521    2579 factory.go:55] Registering systemd factory
Jul 09 17:08:50.662617 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662555    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 09 17:08:50.662617 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.661510    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-241.ec2.internal.18c0ae25fefa44cf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-241.ec2.internal,UID:ip-10-0-133-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-241.ec2.internal,},FirstTimestamp:2026-07-09 17:08:50.653553871 +0000 UTC m=+0.360766808,LastTimestamp:2026-07-09 17:08:50.653553871 +0000 UTC m=+0.360766808,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-241.ec2.internal,}"
Jul 09 17:08:50.662760 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662639    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l5k98"
Jul 09 17:08:50.663016 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.662996    2579 factory.go:153] Registering CRI-O factory
Jul 09 17:08:50.663016 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.663019    2579 factory.go:223] Registration of the crio container factory successfully
Jul 09 17:08:50.663177 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.663107    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 17:08:50.663177 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.663140    2579 factory.go:103] Registering Raw factory
Jul 09 17:08:50.663177 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.663153    2579 manager.go:1196] Started watching for new ooms in manager
Jul 09 17:08:50.663550 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.663532    2579 manager.go:349] Starting recovery of all containers
Jul 09 17:08:50.665248 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.665192    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 17:08:50.665378 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.665356    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 17:08:50.669345 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.668884    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l5k98"
Jul 09 17:08:50.675374 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.675349    2579 manager.go:354] Recovery completed
Jul 09 17:08:50.680096 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.680077    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:08:50.682969 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.682951    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:08:50.683049 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.682987    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:08:50.683049 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.683000    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:08:50.683517 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.683501    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 17:08:50.683517 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.683515    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 17:08:50.683645 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.683533    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:08:50.683645 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.683536    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 17:08:50.684875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.684864    2579 policy_none.go:49] "None policy: Start"
Jul 09 17:08:50.684923 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.684884    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 17:08:50.684923 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.684894    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 17:08:50.685094 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.685026    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-241.ec2.internal.18c0ae2600bb216d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-241.ec2.internal,UID:ip-10-0-133-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-241.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-241.ec2.internal,},FirstTimestamp:2026-07-09 17:08:50.682970477 +0000 UTC m=+0.390183418,LastTimestamp:2026-07-09 17:08:50.682970477 +0000 UTC m=+0.390183418,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-241.ec2.internal,}"
Jul 09 17:08:50.686271 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.686259    2579 policy_none.go:47] "Start"
Jul 09 17:08:50.686738 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.686722    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:08:50.686799 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.686752    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:08:50.686799 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.686767    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:08:50.722491 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.722468    2579 manager.go:337] "Starting Device Plugin manager"
Jul 09 17:08:50.722621 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.722558    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 17:08:50.722621 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.722573    2579 server.go:87] "Starting device plugin registration server"
Jul 09 17:08:50.722885 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.722874    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 17:08:50.722928 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.722887    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 17:08:50.723002 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.722983    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 17:08:50.723104 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.723085    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 17:08:50.723104 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.723103    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 17:08:50.723773 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.723755    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 17:08:50.723855 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.723832    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:50.807767 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.807723    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 17:08:50.809064 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.808948    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 17:08:50.809064 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.808983    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 17:08:50.809064 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.809011    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 17:08:50.809064 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.809047    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 17:08:50.811671 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.811652    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:08:50.823693 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.823665    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:08:50.824781 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.824762    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:08:50.824925 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.824800    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:08:50.824925 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.824828    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:08:50.824925 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.824868    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.831754 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.831732    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.831871 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.831775    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-241.ec2.internal\": node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:50.846730 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.846654    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:50.909452 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.909409    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal"]
Jul 09 17:08:50.909619 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.909497    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:08:50.911293 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.911271    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:08:50.911407 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.911307    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:08:50.911407 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.911321    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:08:50.912731 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.912717    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:08:50.912889 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.912873    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.912935 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.912912    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:08:50.914007 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.913988    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:08:50.914118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.914022    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:08:50.914118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.914034    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:08:50.914118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.913989    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:08:50.914118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.914076    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:08:50.914118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.914093    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:08:50.915383 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.915364    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.915472 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.915401    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:08:50.916205 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.916185    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:08:50.916314 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.916218    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:08:50.916314 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.916233    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:08:50.931562 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.931531    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-241.ec2.internal\" not found" node="ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.935337 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.935318    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-241.ec2.internal\" not found" node="ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.947428 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:50.947397    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:50.964114 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.964086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.964199 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.964163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9589e3ff13c764f99fd24813eb6a730b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-241.ec2.internal\" (UID: \"9589e3ff13c764f99fd24813eb6a730b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:50.964199 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:50.964182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.048283 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.048251    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.064352 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.064322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.064424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.064353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.064424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.064386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9589e3ff13c764f99fd24813eb6a730b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-241.ec2.internal\" (UID: \"9589e3ff13c764f99fd24813eb6a730b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.064424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.064418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.064516 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.064427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.064516 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.064462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9589e3ff13c764f99fd24813eb6a730b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-241.ec2.internal\" (UID: \"9589e3ff13c764f99fd24813eb6a730b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.148780 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.148699    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.234290 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.234262    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.238585 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.238566    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.249677 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.249650    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.350249 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.350196    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.450802 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.450712    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.551377 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.551333    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.573382 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.573361    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:08:51.605373 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.605346    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 17:08:51.605929 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.605537    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 17:08:51.605929 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.605563    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 17:08:51.651897 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.651862    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.672761 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.672720    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 17:03:50 +0000 UTC" deadline="2028-01-04 14:37:40.889468842 +0000 UTC"
Jul 09 17:08:51.672761 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.672752    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13053h28m49.216720725s"
Jul 09 17:08:51.707248 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.707158    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:08:51.752558 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.752527    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.853088 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:51.853038    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found"
Jul 09 17:08:51.913013 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.912982    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:08:51.938822 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:51.938787    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9589e3ff13c764f99fd24813eb6a730b.slice/crio-af90c50bbba52ed50416b20009e9e9736b637a2153993fa8abbaabb9951ecef0 WatchSource:0}: Error finding container af90c50bbba52ed50416b20009e9e9736b637a2153993fa8abbaabb9951ecef0: Status 404 returned error can't find the container with id af90c50bbba52ed50416b20009e9e9736b637a2153993fa8abbaabb9951ecef0
Jul 09 17:08:51.939359 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:51.939335    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47076b8004fedbd1f52e8d569b344586.slice/crio-dde3964b8561f8f2f8433d9e995175ed188f36869008cd3adc9612ec2d8a63af WatchSource:0}: Error finding container dde3964b8561f8f2f8433d9e995175ed188f36869008cd3adc9612ec2d8a63af: Status 404 returned error can't find the container with id dde3964b8561f8f2f8433d9e995175ed188f36869008cd3adc9612ec2d8a63af
Jul 09 17:08:51.945520 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.945493    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:08:51.961951 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.961856    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.973715 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.973686    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 17:08:51.974777 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.974758    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal"
Jul 09 17:08:51.981034 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:51.981009    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 17:08:52.646305 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.646263    2579 apiserver.go:52] "Watching apiserver"
Jul 09 17:08:52.654758 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.654736    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 17:08:52.657585 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.657562    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-84ng9","openshift-ovn-kubernetes/ovnkube-node-76nj5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw","openshift-cluster-node-tuning-operator/tuned-cxkm9","openshift-dns/node-resolver-s7cpk","openshift-image-registry/node-ca-n5ct4","openshift-multus/multus-additional-cni-plugins-w62z5","openshift-multus/multus-mdqhl","openshift-multus/network-metrics-daemon-l28vt","openshift-network-diagnostics/network-check-target-vzmg6","kube-system/global-pull-secret-syncer-jt9kd","kube-system/konnectivity-agent-2ms5r","kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal"]
Jul 09 17:08:52.660311 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.660288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.661820 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.661793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.662118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.662047    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 17:08:52.662912 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.662890    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:08:52.663001 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.662956    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 17:08:52.663065 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.662957    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 17:08:52.663065 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.663026    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kqbnz\""
Jul 09 17:08:52.663451 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.663433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.664077 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.664059    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gmfjq\""
Jul 09 17:08:52.664496 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.664474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 17:08:52.664770 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.664750    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 17:08:52.665376 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.665345    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.666353 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.666330    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 17:08:52.667039 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.667017    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 17:08:52.667131 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.667096    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 17:08:52.667434 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.667398    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 17:08:52.667718 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.667562    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 17:08:52.667718 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.667573    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 17:08:52.667718 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.667621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sltzb\""
Jul 09 17:08:52.668039 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.667989    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:08:52.668641 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.668388    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 17:08:52.668641 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.668481    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tmdp5\""
Jul 09 17:08:52.668787 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.668724    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 17:08:52.669913 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.669574    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.671568 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.671547    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.672079 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.672059    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cltd2\""
Jul 09 17:08:52.672175 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.672065    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 17:08:52.672175 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.672094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 17:08:52.673149 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.673127    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.674039 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.674017    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 17:08:52.674137 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.674071    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 17:08:52.674248 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.674233    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p8zcn\""
Jul 09 17:08:52.674345 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.674325    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 17:08:52.674729 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.674711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.674729 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.674722    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 17:08:52.675105 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675091    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 17:08:52.675420 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-sys-fs\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.675457 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-systemd-units\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675496 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovnkube-script-lib\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675496 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-ovn\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675591 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovnkube-config\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675591 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675535    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 17:08:52.675591 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glg4d\" (UniqueName: \"kubernetes.io/projected/efe8cdad-7cb9-4ddf-a001-ac6234be60db-kube-api-access-glg4d\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.675591 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-var-lib-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-registration-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-cni-bin\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-cni-netd\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-env-overrides\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-socket-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675772    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-node-log\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.675798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675800    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-log-socket\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675861    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-device-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-kubelet\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-systemd\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.675990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-etc-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ea77df3-45de-450a-96d5-311158313273-iptables-alerter-script\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jtpc\" (UniqueName: \"kubernetes.io/projected/4ea77df3-45de-450a-96d5-311158313273-kube-api-access-2jtpc\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxmcp\" (UniqueName: \"kubernetes.io/projected/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-kube-api-access-rxmcp\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ea77df3-45de-450a-96d5-311158313273-host-slash\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.676249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-slash\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676749 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-run-netns\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676749 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovn-node-metrics-cert\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.676749 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676427    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hzftv\""
Jul 09 17:08:52.676749 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-etc-selinux\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.676749 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.676534    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:52.676749 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.676601    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:08:52.677041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.677026    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 17:08:52.677097 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.677081    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mzt5m\""
Jul 09 17:08:52.678244 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.678203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:52.678337 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.678293    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:08:52.679642 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.679626    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.679735 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.679691    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:08:52.681565 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.681549    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:08:52.683671 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.683650    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 17:08:52.684072 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.684051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 17:08:52.684170 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.684053    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xcgzj\""
Jul 09 17:08:52.699016 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.698995    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7dzpr"
Jul 09 17:08:52.709837 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.709807    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7dzpr"
Jul 09 17:08:52.763995 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.763960    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 17:08:52.777588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-host\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.777588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.777588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-multus-certs\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-etc-kubernetes\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e8523e9-f782-472b-b6ee-72d2a2c2393a-agent-certs\") pod \"konnectivity-agent-2ms5r\" (UID: \"9e8523e9-f782-472b-b6ee-72d2a2c2393a\") " pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-socket-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f54b4f19-62e8-4495-ae0e-a62f938f7436-kubelet-config\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f54b4f19-62e8-4495-ae0e-a62f938f7436-dbus\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82djv\" (UniqueName: \"kubernetes.io/projected/e9737d5e-7c24-4e9c-8516-dd865fee4e56-kube-api-access-82djv\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-cni-bin\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-hostroot\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-socket-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.777997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gdlf\" (UniqueName: \"kubernetes.io/projected/4d59db3b-ff13-4325-a439-52f95b3d560d-kube-api-access-2gdlf\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-node-log\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.778047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-log-socket\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lbts\" (UniqueName: \"kubernetes.io/projected/ca587186-12b5-4500-a9bc-951dc8e98161-kube-api-access-9lbts\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-os-release\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-node-log\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-os-release\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-log-socket\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-systemd\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-systemd\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-etc-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-etc-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-host\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778312    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysconfig\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysctl-conf\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-systemd\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-k8s-cni-cncf-io\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ea77df3-45de-450a-96d5-311158313273-iptables-alerter-script\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2562b30c-93aa-4784-8555-6db28c59b897-hosts-file\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.778742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-sys\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca587186-12b5-4500-a9bc-951dc8e98161-tmp\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpcvn\" (UniqueName: \"kubernetes.io/projected/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-kube-api-access-qpcvn\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ea77df3-45de-450a-96d5-311158313273-host-slash\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-sys-fs\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778592    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ea77df3-45de-450a-96d5-311158313273-host-slash\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysctl-d\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-cni-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-cni-multus\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-sys-fs\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-daemon-config\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovnkube-script-lib\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-socket-dir-parent\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-netns\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.778981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-ovn\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.779632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ea77df3-45de-450a-96d5-311158313273-iptables-alerter-script\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4fbn\" (UniqueName: \"kubernetes.io/projected/2562b30c-93aa-4784-8555-6db28c59b897-kube-api-access-z4fbn\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-ovn\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-system-cni-dir\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-cnibin\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-registration-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-run\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca587186-12b5-4500-a9bc-951dc8e98161-etc-tuned\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-registration-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-cni-bin\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-cni-netd\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-env-overrides\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-cni-netd\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.780574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779449    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-cni-bin\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-modprobe-d\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779504    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-kubelet\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovnkube-script-lib\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779611    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-device-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779657    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-kubelet\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779668    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-device-dir\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-conf-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jtpc\" (UniqueName: \"kubernetes.io/projected/4ea77df3-45de-450a-96d5-311158313273-kube-api-access-2jtpc\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-kubelet\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxmcp\" (UniqueName: \"kubernetes.io/projected/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-kube-api-access-rxmcp\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2562b30c-93aa-4784-8555-6db28c59b897-tmp-dir\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.781340 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-run-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-env-overrides\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-serviceca\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-var-lib-kubelet\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cnibin\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-slash\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.779995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-run-netns\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovn-node-metrics-cert\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-etc-selinux\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-run-netns\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-host-slash\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-lib-modules\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d59db3b-ff13-4325-a439-52f95b3d560d-cni-binary-copy\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efe8cdad-7cb9-4ddf-a001-ac6234be60db-etc-selinux\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-systemd-units\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovnkube-config\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glg4d\" (UniqueName: \"kubernetes.io/projected/efe8cdad-7cb9-4ddf-a001-ac6234be60db-kube-api-access-glg4d\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.781938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kwqk\" (UniqueName: \"kubernetes.io/projected/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-kube-api-access-8kwqk\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-kubernetes\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780314    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cni-binary-copy\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-systemd-units\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780428    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-system-cni-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e8523e9-f782-472b-b6ee-72d2a2c2393a-konnectivity-ca\") pod \"konnectivity-agent-2ms5r\" (UID: \"9e8523e9-f782-472b-b6ee-72d2a2c2393a\") " pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-var-lib-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-var-lib-openvswitch\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.782931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.780828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovnkube-config\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.783698 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.783525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-ovn-node-metrics-cert\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.788350 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.788325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jtpc\" (UniqueName: \"kubernetes.io/projected/4ea77df3-45de-450a-96d5-311158313273-kube-api-access-2jtpc\") pod \"iptables-alerter-84ng9\" (UID: \"4ea77df3-45de-450a-96d5-311158313273\") " pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.788350 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.788344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxmcp\" (UniqueName: \"kubernetes.io/projected/dd3869dd-ae6e-458e-ac82-6c601c2fc1bb-kube-api-access-rxmcp\") pod \"ovnkube-node-76nj5\" (UID: \"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.788505 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.788468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glg4d\" (UniqueName: \"kubernetes.io/projected/efe8cdad-7cb9-4ddf-a001-ac6234be60db-kube-api-access-glg4d\") pod \"aws-ebs-csi-driver-node-ld6cw\" (UID: \"efe8cdad-7cb9-4ddf-a001-ac6234be60db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.816673 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.816566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" event={"ID":"47076b8004fedbd1f52e8d569b344586","Type":"ContainerStarted","Data":"dde3964b8561f8f2f8433d9e995175ed188f36869008cd3adc9612ec2d8a63af"}
Jul 09 17:08:52.818625 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.818581    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" event={"ID":"9589e3ff13c764f99fd24813eb6a730b","Type":"ContainerStarted","Data":"af90c50bbba52ed50416b20009e9e9736b637a2153993fa8abbaabb9951ecef0"}
Jul 09 17:08:52.881321 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881250    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cnibin\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.881321 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-lib-modules\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.881321 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d59db3b-ff13-4325-a439-52f95b3d560d-cni-binary-copy\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kwqk\" (UniqueName: \"kubernetes.io/projected/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-kube-api-access-8kwqk\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-kubernetes\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cni-binary-copy\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-system-cni-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e8523e9-f782-472b-b6ee-72d2a2c2393a-konnectivity-ca\") pod \"konnectivity-agent-2ms5r\" (UID: \"9e8523e9-f782-472b-b6ee-72d2a2c2393a\") " pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-host\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-multus-certs\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-etc-kubernetes\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881554    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cnibin\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-etc-kubernetes\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.881630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881653    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-host\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e8523e9-f782-472b-b6ee-72d2a2c2393a-agent-certs\") pod \"konnectivity-agent-2ms5r\" (UID: \"9e8523e9-f782-472b-b6ee-72d2a2c2393a\") " pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f54b4f19-62e8-4495-ae0e-a62f938f7436-kubelet-config\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f54b4f19-62e8-4495-ae0e-a62f938f7436-dbus\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82djv\" (UniqueName: \"kubernetes.io/projected/e9737d5e-7c24-4e9c-8516-dd865fee4e56-kube-api-access-82djv\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-cni-bin\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-hostroot\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gdlf\" (UniqueName: \"kubernetes.io/projected/4d59db3b-ff13-4325-a439-52f95b3d560d-kube-api-access-2gdlf\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lbts\" (UniqueName: \"kubernetes.io/projected/ca587186-12b5-4500-a9bc-951dc8e98161-kube-api-access-9lbts\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-os-release\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-os-release\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-host\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysconfig\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysctl-conf\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-systemd\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-k8s-cni-cncf-io\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.881988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2562b30c-93aa-4784-8555-6db28c59b897-hosts-file\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.882370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-sys\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca587186-12b5-4500-a9bc-951dc8e98161-tmp\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpcvn\" (UniqueName: \"kubernetes.io/projected/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-kube-api-access-qpcvn\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-multus-certs\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysctl-d\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-cni-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-cni-multus\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-daemon-config\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysctl-d\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882254    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-cni-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882260    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-os-release\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-cni-multus\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e8523e9-f782-472b-b6ee-72d2a2c2393a-konnectivity-ca\") pod \"konnectivity-agent-2ms5r\" (UID: \"9e8523e9-f782-472b-b6ee-72d2a2c2393a\") " pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-host\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-socket-dir-parent\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-k8s-cni-cncf-io\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.883279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882359    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-systemd\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882375    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f54b4f19-62e8-4495-ae0e-a62f938f7436-dbus\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2562b30c-93aa-4784-8555-6db28c59b897-hosts-file\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-sys\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysctl-conf\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-cni-bin\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-lib-modules\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.882728    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.882801    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret podName:f54b4f19-62e8-4495-ae0e-a62f938f7436 nodeName:}" failed. No retries permitted until 2026-07-09 17:08:53.382779094 +0000 UTC m=+3.089992019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret") pod "global-pull-secret-syncer-jt9kd" (UID: "f54b4f19-62e8-4495-ae0e-a62f938f7436") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d59db3b-ff13-4325-a439-52f95b3d560d-cni-binary-copy\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882835    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cni-binary-copy\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-daemon-config\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-kubernetes\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-system-cni-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f54b4f19-62e8-4495-ae0e-a62f938f7436-kubelet-config\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.882265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-socket-dir-parent\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-os-release\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-netns\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-hostroot\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-sysconfig\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4fbn\" (UniqueName: \"kubernetes.io/projected/2562b30c-93aa-4784-8555-6db28c59b897-kube-api-access-z4fbn\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-run-netns\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-system-cni-dir\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-cnibin\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.883181    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-run\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca587186-12b5-4500-a9bc-951dc8e98161-etc-tuned\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.883244    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs podName:c4557ec4-4b4f-41ec-9926-be1e9fb7948e nodeName:}" failed. No retries permitted until 2026-07-09 17:08:53.383225217 +0000 UTC m=+3.090438158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs") pod "network-metrics-daemon-l28vt" (UID: "c4557ec4-4b4f-41ec-9926-be1e9fb7948e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883285    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-cnibin\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-system-cni-dir\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-run\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-modprobe-d\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.884914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-kubelet\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-conf-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-etc-modprobe-d\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9737d5e-7c24-4e9c-8516-dd865fee4e56-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2562b30c-93aa-4784-8555-6db28c59b897-tmp-dir\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-host-var-lib-kubelet\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-serviceca\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-var-lib-kubelet\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca587186-12b5-4500-a9bc-951dc8e98161-var-lib-kubelet\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d59db3b-ff13-4325-a439-52f95b3d560d-multus-conf-dir\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2562b30c-93aa-4784-8555-6db28c59b897-tmp-dir\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9737d5e-7c24-4e9c-8516-dd865fee4e56-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.883933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-serviceca\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.885569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.885412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca587186-12b5-4500-a9bc-951dc8e98161-tmp\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.886133 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.885708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e8523e9-f782-472b-b6ee-72d2a2c2393a-agent-certs\") pod \"konnectivity-agent-2ms5r\" (UID: \"9e8523e9-f782-472b-b6ee-72d2a2c2393a\") " pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:08:52.886133 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.885854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca587186-12b5-4500-a9bc-951dc8e98161-etc-tuned\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.890865 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.890128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kwqk\" (UniqueName: \"kubernetes.io/projected/fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb-kube-api-access-8kwqk\") pod \"node-ca-n5ct4\" (UID: \"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb\") " pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:52.893601 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.893478    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:08:52.893601 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.893505    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:08:52.893601 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.893519    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4gzfv for pod openshift-network-diagnostics/network-check-target-vzmg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:08:52.893601 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:52.893589    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv podName:275abdc9-eb22-47eb-ad33-a1edd21cda48 nodeName:}" failed. No retries permitted until 2026-07-09 17:08:53.393566924 +0000 UTC m=+3.100779855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4gzfv" (UniqueName: "kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv") pod "network-check-target-vzmg6" (UID: "275abdc9-eb22-47eb-ad33-a1edd21cda48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:08:52.896050 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.895991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpcvn\" (UniqueName: \"kubernetes.io/projected/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-kube-api-access-qpcvn\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:52.896710 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.896616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82djv\" (UniqueName: \"kubernetes.io/projected/e9737d5e-7c24-4e9c-8516-dd865fee4e56-kube-api-access-82djv\") pod \"multus-additional-cni-plugins-w62z5\" (UID: \"e9737d5e-7c24-4e9c-8516-dd865fee4e56\") " pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:52.898659 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.898589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gdlf\" (UniqueName: \"kubernetes.io/projected/4d59db3b-ff13-4325-a439-52f95b3d560d-kube-api-access-2gdlf\") pod \"multus-mdqhl\" (UID: \"4d59db3b-ff13-4325-a439-52f95b3d560d\") " pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:52.899460 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.899109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lbts\" (UniqueName: \"kubernetes.io/projected/ca587186-12b5-4500-a9bc-951dc8e98161-kube-api-access-9lbts\") pod \"tuned-cxkm9\" (UID: \"ca587186-12b5-4500-a9bc-951dc8e98161\") " pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.899956 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.899936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4fbn\" (UniqueName: \"kubernetes.io/projected/2562b30c-93aa-4784-8555-6db28c59b897-kube-api-access-z4fbn\") pod \"node-resolver-s7cpk\" (UID: \"2562b30c-93aa-4784-8555-6db28c59b897\") " pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:52.973512 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.973280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84ng9"
Jul 09 17:08:52.974684 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.974457    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:08:52.981508 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.981482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:08:52.984891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:52.984852    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea77df3_45de_450a_96d5_311158313273.slice/crio-19e0fe24f0a03c5e9de7512e2188e7fda013693c34c80064bee4b85107a09359 WatchSource:0}: Error finding container 19e0fe24f0a03c5e9de7512e2188e7fda013693c34c80064bee4b85107a09359: Status 404 returned error can't find the container with id 19e0fe24f0a03c5e9de7512e2188e7fda013693c34c80064bee4b85107a09359
Jul 09 17:08:52.988707 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.988507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw"
Jul 09 17:08:52.990792 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:52.990758    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3869dd_ae6e_458e_ac82_6c601c2fc1bb.slice/crio-de09940097b664316895121a680a24de5dc931fbded3fca35ed52cb61d25581e WatchSource:0}: Error finding container de09940097b664316895121a680a24de5dc931fbded3fca35ed52cb61d25581e: Status 404 returned error can't find the container with id de09940097b664316895121a680a24de5dc931fbded3fca35ed52cb61d25581e
Jul 09 17:08:52.993398 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.993376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cxkm9"
Jul 09 17:08:52.998925 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:52.998877    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe8cdad_7cb9_4ddf_a001_ac6234be60db.slice/crio-78ebef8efaab2e14e25826b4eb790a49cd581617f0fd0ef7db0c2985afe500ea WatchSource:0}: Error finding container 78ebef8efaab2e14e25826b4eb790a49cd581617f0fd0ef7db0c2985afe500ea: Status 404 returned error can't find the container with id 78ebef8efaab2e14e25826b4eb790a49cd581617f0fd0ef7db0c2985afe500ea
Jul 09 17:08:52.999552 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:52.999533    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s7cpk"
Jul 09 17:08:53.006186 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.006162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n5ct4"
Jul 09 17:08:53.011556 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.011376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w62z5"
Jul 09 17:08:53.012713 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:53.012680    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2562b30c_93aa_4784_8555_6db28c59b897.slice/crio-3897f6e190b59e4ef7384acffe5c3a2aa135e020fe26d33860ae04742a317372 WatchSource:0}: Error finding container 3897f6e190b59e4ef7384acffe5c3a2aa135e020fe26d33860ae04742a317372: Status 404 returned error can't find the container with id 3897f6e190b59e4ef7384acffe5c3a2aa135e020fe26d33860ae04742a317372
Jul 09 17:08:53.018241 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.017346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mdqhl"
Jul 09 17:08:53.021982 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.021952    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:08:53.024145 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:53.024118    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4b4f51_3bfd_414d_b08a_1ec78f83c0fb.slice/crio-0cebec469ebd07a5bd7f62ee7145e283e14444767e53492a004200f1ee34971f WatchSource:0}: Error finding container 0cebec469ebd07a5bd7f62ee7145e283e14444767e53492a004200f1ee34971f: Status 404 returned error can't find the container with id 0cebec469ebd07a5bd7f62ee7145e283e14444767e53492a004200f1ee34971f
Jul 09 17:08:53.031271 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:53.031229    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9737d5e_7c24_4e9c_8516_dd865fee4e56.slice/crio-2883f102be222801783e2d847802cef38e007f2091c359a977f9c3ca7e47a581 WatchSource:0}: Error finding container 2883f102be222801783e2d847802cef38e007f2091c359a977f9c3ca7e47a581: Status 404 returned error can't find the container with id 2883f102be222801783e2d847802cef38e007f2091c359a977f9c3ca7e47a581
Jul 09 17:08:53.032946 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:53.032917    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d59db3b_ff13_4325_a439_52f95b3d560d.slice/crio-7355ed4a3db2e2253493781e536e3676571235c346f9bf0f5182bdf24b62010d WatchSource:0}: Error finding container 7355ed4a3db2e2253493781e536e3676571235c346f9bf0f5182bdf24b62010d: Status 404 returned error can't find the container with id 7355ed4a3db2e2253493781e536e3676571235c346f9bf0f5182bdf24b62010d
Jul 09 17:08:53.041814 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:08:53.041690    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8523e9_f782_472b_b6ee_72d2a2c2393a.slice/crio-ad497d55a16d916e2797405f78408c27c26e5026def4b058332d43362e019e93 WatchSource:0}: Error finding container ad497d55a16d916e2797405f78408c27c26e5026def4b058332d43362e019e93: Status 404 returned error can't find the container with id ad497d55a16d916e2797405f78408c27c26e5026def4b058332d43362e019e93
Jul 09 17:08:53.387280 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.387157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:53.387280 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.387196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:53.387512 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.387326    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:08:53.387512 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.387379    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs podName:c4557ec4-4b4f-41ec-9926-be1e9fb7948e nodeName:}" failed. No retries permitted until 2026-07-09 17:08:54.387364807 +0000 UTC m=+4.094577733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs") pod "network-metrics-daemon-l28vt" (UID: "c4557ec4-4b4f-41ec-9926-be1e9fb7948e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:08:53.387629 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.387540    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:08:53.387629 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.387616    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret podName:f54b4f19-62e8-4495-ae0e-a62f938f7436 nodeName:}" failed. No retries permitted until 2026-07-09 17:08:54.387596842 +0000 UTC m=+4.094809772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret") pod "global-pull-secret-syncer-jt9kd" (UID: "f54b4f19-62e8-4495-ae0e-a62f938f7436") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:08:53.487806 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.487763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:53.488035 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.487970    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:08:53.488035 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.488000    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:08:53.488035 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.488016    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4gzfv for pod openshift-network-diagnostics/network-check-target-vzmg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:08:53.488208 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.488093    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv podName:275abdc9-eb22-47eb-ad33-a1edd21cda48 nodeName:}" failed. No retries permitted until 2026-07-09 17:08:54.488071 +0000 UTC m=+4.195283929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gzfv" (UniqueName: "kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv") pod "network-check-target-vzmg6" (UID: "275abdc9-eb22-47eb-ad33-a1edd21cda48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:08:53.671564 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.671465    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:08:53.712168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.712091    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:03:52 +0000 UTC" deadline="2028-01-16 23:51:23.670552159 +0000 UTC"
Jul 09 17:08:53.712168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.712162    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13350h42m29.958393469s"
Jul 09 17:08:53.810200 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.810164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:53.810388 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.810164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:53.810388 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.810338    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:08:53.810499 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:53.810458    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:08:53.822193 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.822155    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"de09940097b664316895121a680a24de5dc931fbded3fca35ed52cb61d25581e"}
Jul 09 17:08:53.823695 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.823627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2ms5r" event={"ID":"9e8523e9-f782-472b-b6ee-72d2a2c2393a","Type":"ContainerStarted","Data":"ad497d55a16d916e2797405f78408c27c26e5026def4b058332d43362e019e93"}
Jul 09 17:08:53.825247 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.825214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n5ct4" event={"ID":"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb","Type":"ContainerStarted","Data":"0cebec469ebd07a5bd7f62ee7145e283e14444767e53492a004200f1ee34971f"}
Jul 09 17:08:53.826735 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.826708    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s7cpk" event={"ID":"2562b30c-93aa-4784-8555-6db28c59b897","Type":"ContainerStarted","Data":"3897f6e190b59e4ef7384acffe5c3a2aa135e020fe26d33860ae04742a317372"}
Jul 09 17:08:53.828065 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.828025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84ng9" event={"ID":"4ea77df3-45de-450a-96d5-311158313273","Type":"ContainerStarted","Data":"19e0fe24f0a03c5e9de7512e2188e7fda013693c34c80064bee4b85107a09359"}
Jul 09 17:08:53.829518 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.829490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mdqhl" event={"ID":"4d59db3b-ff13-4325-a439-52f95b3d560d","Type":"ContainerStarted","Data":"7355ed4a3db2e2253493781e536e3676571235c346f9bf0f5182bdf24b62010d"}
Jul 09 17:08:53.830804 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.830783    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerStarted","Data":"2883f102be222801783e2d847802cef38e007f2091c359a977f9c3ca7e47a581"}
Jul 09 17:08:53.832051 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.832026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cxkm9" event={"ID":"ca587186-12b5-4500-a9bc-951dc8e98161","Type":"ContainerStarted","Data":"9e8908f840957094e01f0aa86ef7c97a1e12eea1cdd1b188fbc24d0d6f6e16ac"}
Jul 09 17:08:53.833263 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:53.833238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw" event={"ID":"efe8cdad-7cb9-4ddf-a001-ac6234be60db","Type":"ContainerStarted","Data":"78ebef8efaab2e14e25826b4eb790a49cd581617f0fd0ef7db0c2985afe500ea"}
Jul 09 17:08:54.396419 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:54.396322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:54.396419 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:54.396379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:54.401195 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.401158    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:08:54.401354 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.401267    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret podName:f54b4f19-62e8-4495-ae0e-a62f938f7436 nodeName:}" failed. No retries permitted until 2026-07-09 17:08:56.401241826 +0000 UTC m=+6.108454770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret") pod "global-pull-secret-syncer-jt9kd" (UID: "f54b4f19-62e8-4495-ae0e-a62f938f7436") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:08:54.401858 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.401837    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:08:54.401962 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.401929    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs podName:c4557ec4-4b4f-41ec-9926-be1e9fb7948e nodeName:}" failed. No retries permitted until 2026-07-09 17:08:56.401901475 +0000 UTC m=+6.109114412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs") pod "network-metrics-daemon-l28vt" (UID: "c4557ec4-4b4f-41ec-9926-be1e9fb7948e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:08:54.498025 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:54.497980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:54.498264 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.498237    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:08:54.498341 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.498276    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:08:54.498341 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.498292    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4gzfv for pod openshift-network-diagnostics/network-check-target-vzmg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:08:54.498520 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.498356    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv podName:275abdc9-eb22-47eb-ad33-a1edd21cda48 nodeName:}" failed. No retries permitted until 2026-07-09 17:08:56.498336987 +0000 UTC m=+6.205549919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gzfv" (UniqueName: "kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv") pod "network-check-target-vzmg6" (UID: "275abdc9-eb22-47eb-ad33-a1edd21cda48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:08:54.713064 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:54.712862    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:03:52 +0000 UTC" deadline="2028-04-22 04:45:57.048274164 +0000 UTC"
Jul 09 17:08:54.713064 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:54.712948    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15659h37m2.335330801s"
Jul 09 17:08:54.810149 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:54.810110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:54.810363 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:54.810277    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:08:55.810481 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:55.809489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:55.810481 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:55.809620    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:08:55.810481 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:55.810033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:55.810481 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:55.810123    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:08:55.862444 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:55.862406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" event={"ID":"9589e3ff13c764f99fd24813eb6a730b","Type":"ContainerStarted","Data":"fdd0ce4d93736dd1ac58b1d72ccf60650a5edc91c7db755a682b27a7133425a8"}
Jul 09 17:08:55.878084 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:55.878018    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" podStartSLOduration=3.877997003 podStartE2EDuration="3.877997003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:08:55.877373584 +0000 UTC m=+5.584586531" watchObservedRunningTime="2026-07-09 17:08:55.877997003 +0000 UTC m=+5.585209950"
Jul 09 17:08:56.416064 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:56.416023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:56.416357 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:56.416139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:56.416357 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.416171    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:08:56.416357 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.416251    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs podName:c4557ec4-4b4f-41ec-9926-be1e9fb7948e nodeName:}" failed. No retries permitted until 2026-07-09 17:09:00.416228875 +0000 UTC m=+10.123441819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs") pod "network-metrics-daemon-l28vt" (UID: "c4557ec4-4b4f-41ec-9926-be1e9fb7948e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:08:56.416357 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.416251    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:08:56.416357 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.416317    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret podName:f54b4f19-62e8-4495-ae0e-a62f938f7436 nodeName:}" failed. No retries permitted until 2026-07-09 17:09:00.416300408 +0000 UTC m=+10.123513337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret") pod "global-pull-secret-syncer-jt9kd" (UID: "f54b4f19-62e8-4495-ae0e-a62f938f7436") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:08:56.516752 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:56.516713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:56.516953 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.516891    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:08:56.516953 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.516916    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:08:56.516953 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.516928    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4gzfv for pod openshift-network-diagnostics/network-check-target-vzmg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:08:56.517105 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.516989    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv podName:275abdc9-eb22-47eb-ad33-a1edd21cda48 nodeName:}" failed. No retries permitted until 2026-07-09 17:09:00.516969732 +0000 UTC m=+10.224182661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gzfv" (UniqueName: "kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv") pod "network-check-target-vzmg6" (UID: "275abdc9-eb22-47eb-ad33-a1edd21cda48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:08:56.809842 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:56.809746    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:56.810116 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:56.809937    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:08:56.869136 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:56.869099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" event={"ID":"47076b8004fedbd1f52e8d569b344586","Type":"ContainerStarted","Data":"0319a3824b41f9a5729f8aff602b9cb3fbe168c10d8224e21c6d2296517a1e0f"}
Jul 09 17:08:57.809497 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:57.809457    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:57.809692 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:57.809618    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:08:57.809692 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:57.809685    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:57.809800 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:57.809755    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:08:57.873003 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:57.872964    2579 generic.go:356] "Generic (PLEG): container finished" podID="47076b8004fedbd1f52e8d569b344586" containerID="0319a3824b41f9a5729f8aff602b9cb3fbe168c10d8224e21c6d2296517a1e0f" exitCode=0
Jul 09 17:08:57.873483 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:57.873036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" event={"ID":"47076b8004fedbd1f52e8d569b344586","Type":"ContainerDied","Data":"0319a3824b41f9a5729f8aff602b9cb3fbe168c10d8224e21c6d2296517a1e0f"}
Jul 09 17:08:58.812581 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:58.812545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:08:58.812761 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:58.812700    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:08:59.810006 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:59.809967    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:08:59.810434 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:08:59.809967    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:08:59.810434 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:59.810116    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:08:59.810434 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:08:59.810195    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:00.450329 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:00.450285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:00.450506 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:00.450343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:00.450506 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.450461    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:09:00.450506 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.450489    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:09:00.450630 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.450535    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret podName:f54b4f19-62e8-4495-ae0e-a62f938f7436 nodeName:}" failed. No retries permitted until 2026-07-09 17:09:08.450512892 +0000 UTC m=+18.157725816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret") pod "global-pull-secret-syncer-jt9kd" (UID: "f54b4f19-62e8-4495-ae0e-a62f938f7436") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:09:00.450630 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.450552    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs podName:c4557ec4-4b4f-41ec-9926-be1e9fb7948e nodeName:}" failed. No retries permitted until 2026-07-09 17:09:08.450545325 +0000 UTC m=+18.157758249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs") pod "network-metrics-daemon-l28vt" (UID: "c4557ec4-4b4f-41ec-9926-be1e9fb7948e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:09:00.551727 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:00.551683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:00.551932 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.551915    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:09:00.552001 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.551936    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:09:00.552001 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.551949    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4gzfv for pod openshift-network-diagnostics/network-check-target-vzmg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:09:00.552103 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.552007    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv podName:275abdc9-eb22-47eb-ad33-a1edd21cda48 nodeName:}" failed. No retries permitted until 2026-07-09 17:09:08.551992102 +0000 UTC m=+18.259205047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gzfv" (UniqueName: "kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv") pod "network-check-target-vzmg6" (UID: "275abdc9-eb22-47eb-ad33-a1edd21cda48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:09:00.811571 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:00.811487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:00.812061 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:00.811661    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:01.810176 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:01.810139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:01.810176 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:01.810159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:01.810428 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:01.810281    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:01.810428 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:01.810411    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:02.809940 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:02.809905    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:02.810374 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:02.810057    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:03.809245 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:03.809218    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:03.809383 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:03.809345    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:03.809485 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:03.809406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:03.809550 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:03.809526    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:03.891032 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:03.890564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" event={"ID":"47076b8004fedbd1f52e8d569b344586","Type":"ContainerStarted","Data":"b50a517056564d3bb511d2dc59f07443b97e69eaffe154e6cce0858637cc126f"}
Jul 09 17:09:03.892118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:03.892088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerStarted","Data":"3d90e96d7dc33385b7b1a29ab3127a54fa060cde90bc09657fd40dcdc35226b8"}
Jul 09 17:09:03.908722 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:03.908661    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" podStartSLOduration=11.908640917 podStartE2EDuration="11.908640917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:03.908339659 +0000 UTC m=+13.615552601" watchObservedRunningTime="2026-07-09 17:09:03.908640917 +0000 UTC m=+13.615853936"
Jul 09 17:09:04.809768 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.809733    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:04.809933 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:04.809880    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:04.897106 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.896999    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2ms5r" event={"ID":"9e8523e9-f782-472b-b6ee-72d2a2c2393a","Type":"ContainerStarted","Data":"ae66960772fac73c6a0105a627d21a3ef5d00fc1bee5026ceb6bf82ed360f886"}
Jul 09 17:09:04.899625 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.899587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n5ct4" event={"ID":"fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb","Type":"ContainerStarted","Data":"74ceaea3587e38e008e94a713090d69049592d743f042cd5fd4af180adc7a496"}
Jul 09 17:09:04.901424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.901393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s7cpk" event={"ID":"2562b30c-93aa-4784-8555-6db28c59b897","Type":"ContainerStarted","Data":"5da6a0764954e206ec74efa7b27e9214c6a3c8b50e3eb107beb236d56f1954c3"}
Jul 09 17:09:04.903449 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.903418    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9737d5e-7c24-4e9c-8516-dd865fee4e56" containerID="3d90e96d7dc33385b7b1a29ab3127a54fa060cde90bc09657fd40dcdc35226b8" exitCode=0
Jul 09 17:09:04.903594 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.903506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerDied","Data":"3d90e96d7dc33385b7b1a29ab3127a54fa060cde90bc09657fd40dcdc35226b8"}
Jul 09 17:09:04.905630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.905603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cxkm9" event={"ID":"ca587186-12b5-4500-a9bc-951dc8e98161","Type":"ContainerStarted","Data":"7a8055b03202cb7ec33e75bcc3ecbf7d0130e756414390784e29d312c648b7e5"}
Jul 09 17:09:04.907397 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.907360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw" event={"ID":"efe8cdad-7cb9-4ddf-a001-ac6234be60db","Type":"ContainerStarted","Data":"f7506e9cf03ee5fb8ced6fef5dff8a1ed0f950a559517dffd0363eb486961617"}
Jul 09 17:09:04.912550 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.912497    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2ms5r" podStartSLOduration=3.266915693 podStartE2EDuration="13.912484241s" totalImagesPullingTime="10.645568548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:04.911405269 +0000 UTC m=+14.618618245" watchObservedRunningTime="2026-07-09 17:09:04.912484241 +0000 UTC m=+14.619697187"
Jul 09 17:09:04.924855 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.924781    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n5ct4" podStartSLOduration=3.268103241 podStartE2EDuration="13.924764946s" totalImagesPullingTime="10.656661705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:04.924476697 +0000 UTC m=+14.631689656" watchObservedRunningTime="2026-07-09 17:09:04.924764946 +0000 UTC m=+14.631977948"
Jul 09 17:09:04.971831 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.971747    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cxkm9" podStartSLOduration=3.040538357 podStartE2EDuration="13.971724503s" totalImagesPullingTime="10.931186146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:04.939474297 +0000 UTC m=+14.646687244" watchObservedRunningTime="2026-07-09 17:09:04.971724503 +0000 UTC m=+14.678937450"
Jul 09 17:09:04.984691 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:04.984575    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s7cpk" podStartSLOduration=3.315101602 podStartE2EDuration="13.98453739s" totalImagesPullingTime="10.669435788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:04.984525347 +0000 UTC m=+14.691738309" watchObservedRunningTime="2026-07-09 17:09:04.98453739 +0000 UTC m=+14.691750334"
Jul 09 17:09:05.469061 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:05.469021    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:09:05.469972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:05.469950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:09:05.810015 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:05.809927    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:05.810015 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:05.809937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:05.810225 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:05.810082    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:05.810225 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:05.810200    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:05.911738 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:05.911699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84ng9" event={"ID":"4ea77df3-45de-450a-96d5-311158313273","Type":"ContainerStarted","Data":"4de91a4f144be3d3a1eff0370b9160aa7888ee652ceb79ad299c41e94040c920"}
Jul 09 17:09:06.810203 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:06.810162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:06.810384 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:06.810314    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:06.913797 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:06.913762    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 17:09:07.810157 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:07.810114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:07.810409 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:07.810112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:07.810409 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:07.810261    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:07.810409 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:07.810363    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:08.512932 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:08.512689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:08.513469 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:08.512960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:08.513469 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.512888    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:09:08.513469 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.513115    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret podName:f54b4f19-62e8-4495-ae0e-a62f938f7436 nodeName:}" failed. No retries permitted until 2026-07-09 17:09:24.513073628 +0000 UTC m=+34.220286557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret") pod "global-pull-secret-syncer-jt9kd" (UID: "f54b4f19-62e8-4495-ae0e-a62f938f7436") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:09:08.513469 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.513119    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:09:08.513469 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.513173    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs podName:c4557ec4-4b4f-41ec-9926-be1e9fb7948e nodeName:}" failed. No retries permitted until 2026-07-09 17:09:24.513156093 +0000 UTC m=+34.220369026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs") pod "network-metrics-daemon-l28vt" (UID: "c4557ec4-4b4f-41ec-9926-be1e9fb7948e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:09:08.613624 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:08.613585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:08.613845 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.613802    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:09:08.613845 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.613840    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:09:08.613845 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.613855    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4gzfv for pod openshift-network-diagnostics/network-check-target-vzmg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:09:08.614093 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.613915    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv podName:275abdc9-eb22-47eb-ad33-a1edd21cda48 nodeName:}" failed. No retries permitted until 2026-07-09 17:09:24.613895057 +0000 UTC m=+34.321107992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gzfv" (UniqueName: "kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv") pod "network-check-target-vzmg6" (UID: "275abdc9-eb22-47eb-ad33-a1edd21cda48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:09:08.811402 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:08.810542    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:08.811402 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:08.811367    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:09.809970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:09.809931    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:09.810430 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:09.809972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:09.810430 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:09.810054    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:09.810430 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:09.810250    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:10.811267 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:10.811230    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:10.811716 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:10.811365    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:11.049560 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:11.049522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:09:11.049747 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:11.049674    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 17:09:11.050224 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:11.050199    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2ms5r"
Jul 09 17:09:11.064756 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:11.064628    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-84ng9" podStartSLOduration=9.364417934 podStartE2EDuration="20.064608754s" totalImagesPullingTime="10.70019082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:05.926417564 +0000 UTC m=+15.633630511" watchObservedRunningTime="2026-07-09 17:09:11.064608754 +0000 UTC m=+20.771821700"
Jul 09 17:09:11.809887 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:11.809829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:11.810078 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:11.809829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:11.810078 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:11.809980    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:11.810078 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:11.810049    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:12.809345 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:12.809310    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:12.809934 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:12.809456    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:13.809623 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:13.809581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:13.809623 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:13.809631    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:13.810109 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:13.809693    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:13.810109 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:13.809859    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:14.809569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:14.809530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:14.809758 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:14.809678    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:14.836215 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:14.836182    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:14.918860 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:14.918822    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:15.777078 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:15.777046    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 17:09:15.809387 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:15.809346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:15.809570 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:15.809346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:15.809570 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:15.809458    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:15.809664 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:15.809565    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:15.933498 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:15.933463    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mdqhl" event={"ID":"4d59db3b-ff13-4325-a439-52f95b3d560d","Type":"ContainerStarted","Data":"cf26a5b659108f819dd9e04dbd69e9d20885ef774185874d5f8e790310fb38d9"}
Jul 09 17:09:15.935321 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:15.935271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw" event={"ID":"efe8cdad-7cb9-4ddf-a001-ac6234be60db","Type":"ContainerStarted","Data":"1d5493c5f6abf1a7cb7ea6291702b2786ec9eb43de8a370424843ff842f1899b"}
Jul 09 17:09:15.937038 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:15.936987    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"91561eb2d00b334f14d732edb6b1f7c374fa6fa78b1022641a36d33642605f32"}
Jul 09 17:09:15.950904 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:15.950847    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mdqhl" podStartSLOduration=2.360193332 podStartE2EDuration="24.950805393s" totalImagesPullingTime="22.590612061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:15.950345736 +0000 UTC m=+25.657558684" watchObservedRunningTime="2026-07-09 17:09:15.950805393 +0000 UTC m=+25.658018339"
Jul 09 17:09:16.075351 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.075262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:16.175748 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.175637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:16.736064 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.735892    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T17:09:15.777070493Z","UUID":"8308aa39-ca21-4953-ac75-bc41f9b493cb","Handler":null,"Name":"","Endpoint":""}
Jul 09 17:09:16.737450 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.737420    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 17:09:16.737450 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.737452    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 17:09:16.810159 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.810121    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:16.810351 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:16.810274    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:16.826793 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.826758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:16.941297 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.941260    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9737d5e-7c24-4e9c-8516-dd865fee4e56" containerID="d0956513e7047287ad7d009af2599b43f06cd52b80ba8ff6c70c8daea0f925a8" exitCode=0
Jul 09 17:09:16.942089 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.941348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerDied","Data":"d0956513e7047287ad7d009af2599b43f06cd52b80ba8ff6c70c8daea0f925a8"}
Jul 09 17:09:16.944586 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.944558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"9e0ca31830a2b1e31077ec0345119492de94eee9d8558ba685f24fef247d9bc2"}
Jul 09 17:09:16.944700 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.944628    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"c6a683e916ab1eef588eecf45b8bd27086e21c51734e845b2216fc00622143d5"}
Jul 09 17:09:16.944700 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.944672    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"8ca0c18b7add341f6ffa4a1a139b5998c6c09286b31d1244cbcaf5fba830131e"}
Jul 09 17:09:16.944833 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.944709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"5968ddd7b8c6b5bd6e8fb01813c33c4919ad6f9a2e40233166c04decd121e679"}
Jul 09 17:09:16.944833 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:16.944746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"8f032dd66f87930ea87afd4a72f20bd1ac844b2780f3b950515a2fe78ded2183"}
Jul 09 17:09:17.216717 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:17.216644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:17.320899 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:17.320861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:17.809473 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:17.809436    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:17.809852 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:17.809548    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:17.809998 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:17.809966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:17.810110 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:17.810090    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:17.948647 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:17.948607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw" event={"ID":"efe8cdad-7cb9-4ddf-a001-ac6234be60db","Type":"ContainerStarted","Data":"0a694f2e2c089e44c03ba4ae5a49965dafcb8aaf8cbc2c4c3edfa7db007c84fc"}
Jul 09 17:09:17.965864 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:17.965798    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ld6cw" podStartSLOduration=3.3493323090000002 podStartE2EDuration="26.965781943s" totalImagesPullingTime="23.616449634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:17.965152626 +0000 UTC m=+27.672365571" watchObservedRunningTime="2026-07-09 17:09:17.965781943 +0000 UTC m=+27.672994888"
Jul 09 17:09:18.809614 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:18.809576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:18.809834 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:18.809701    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:18.952737 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:18.952697    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9737d5e-7c24-4e9c-8516-dd865fee4e56" containerID="84e8a53d9193d2f0cd70ba38b851e36ae0fcc606e7fbf2c4cb2674f5caaaeed5" exitCode=0
Jul 09 17:09:18.953246 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:18.952788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerDied","Data":"84e8a53d9193d2f0cd70ba38b851e36ae0fcc606e7fbf2c4cb2674f5caaaeed5"}
Jul 09 17:09:18.956459 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:18.956434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"af9f2bd1be909ae930bde6d4c8822ea9fccd674227da04da5c8ff795c59c768f"}
Jul 09 17:09:19.019138 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:19.019105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:19.078571 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:19.078498    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:19.809437 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:19.809411    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:19.809620 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:19.809504    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:19.809620 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:19.809533    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:19.809620 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:19.809584    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:20.810674 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:20.810500    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:20.811061 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:20.810738    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:20.963896 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:20.963858    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9737d5e-7c24-4e9c-8516-dd865fee4e56" containerID="34ee53a8424a1a7fb9ddfda9c77fb4f64de62c1d4715b42f38ebb8e121b4590e" exitCode=0
Jul 09 17:09:20.964093 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:20.963940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerDied","Data":"34ee53a8424a1a7fb9ddfda9c77fb4f64de62c1d4715b42f38ebb8e121b4590e"}
Jul 09 17:09:20.967602 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:20.967569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" event={"ID":"dd3869dd-ae6e-458e-ac82-6c601c2fc1bb","Type":"ContainerStarted","Data":"3dbd92c451df28dad2d6b6ae581b91844520fb09758291c2549eaff756da2848"}
Jul 09 17:09:20.967943 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:20.967924    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:09:20.983930 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:20.983783    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:09:21.010228 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:21.010158    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5" podStartSLOduration=7.374910445 podStartE2EDuration="30.010141232s" totalImagesPullingTime="22.635230787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:21.0086266 +0000 UTC m=+30.715839565" watchObservedRunningTime="2026-07-09 17:09:21.010141232 +0000 UTC m=+30.717354179"
Jul 09 17:09:21.809937 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:21.809885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:21.810106 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:21.809889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:21.810106 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:21.810002    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:21.810106 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:21.810074    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:21.970069 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:21.970034    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:09:21.970590 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:21.970103    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:09:21.986007 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:21.985981    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:09:22.060481 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.060379    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:22.130648 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.130018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:22.809685 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.809649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:22.809874 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:22.809785    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:22.834835 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.834782    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vzmg6"]
Jul 09 17:09:22.835048 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.834917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:22.835048 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:22.835012    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:22.835510 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.835488    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jt9kd"]
Jul 09 17:09:22.835581 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.835569    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:22.835672 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:22.835649    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:22.837300 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.837280    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l28vt"]
Jul 09 17:09:22.972805 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:22.972537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:22.973273 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:22.973138    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:24.443091 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:24.443059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:24.496190 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:24.496152    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:24.540309 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:24.540278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:24.540494 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:24.540317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:24.540494 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.540440    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:09:24.540615 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.540504    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret podName:f54b4f19-62e8-4495-ae0e-a62f938f7436 nodeName:}" failed. No retries permitted until 2026-07-09 17:09:56.54048906 +0000 UTC m=+66.247701989 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret") pod "global-pull-secret-syncer-jt9kd" (UID: "f54b4f19-62e8-4495-ae0e-a62f938f7436") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:09:24.540615 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.540440    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:09:24.540615 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.540580    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs podName:c4557ec4-4b4f-41ec-9926-be1e9fb7948e nodeName:}" failed. No retries permitted until 2026-07-09 17:09:56.540567188 +0000 UTC m=+66.247780113 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs") pod "network-metrics-daemon-l28vt" (UID: "c4557ec4-4b4f-41ec-9926-be1e9fb7948e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:09:24.640808 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:24.640764    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:24.640998 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.640944    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:09:24.640998 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.640968    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:09:24.640998 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.640978    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4gzfv for pod openshift-network-diagnostics/network-check-target-vzmg6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:09:24.641111 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.641040    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv podName:275abdc9-eb22-47eb-ad33-a1edd21cda48 nodeName:}" failed. No retries permitted until 2026-07-09 17:09:56.641026457 +0000 UTC m=+66.348239381 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gzfv" (UniqueName: "kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv") pod "network-check-target-vzmg6" (UID: "275abdc9-eb22-47eb-ad33-a1edd21cda48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:09:24.809379 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:24.809347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:24.809570 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.809478    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:24.809570 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:24.809494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:24.809685 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.809569    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:24.809685 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:24.809619    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:24.809685 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:24.809679    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:25.037488 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.037433    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:25.139879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.139764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:25.232225 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.232191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:25.290944 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.290914    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:25.495212 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.495184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:25.595520 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.595483    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:25.724271 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.724149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:25.797532 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.797500    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:25.855555 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:25.855527    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:26.177490 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.177454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:26.275148 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.275097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:26.444035 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.444013    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:26.543682 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.543648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:26.592076 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.592048    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s7cpk_2562b30c-93aa-4784-8555-6db28c59b897/dns-node-resolver/0.log"
Jul 09 17:09:26.644170 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.644142    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:26.809263 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.809230    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:26.809263 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.809246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:26.809514 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:26.809348    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jt9kd" podUID="f54b4f19-62e8-4495-ae0e-a62f938f7436"
Jul 09 17:09:26.809514 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:26.809420    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l28vt" podUID="c4557ec4-4b4f-41ec-9926-be1e9fb7948e"
Jul 09 17:09:26.809514 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.809437    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:26.809611 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:26.809530    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzmg6" podUID="275abdc9-eb22-47eb-ad33-a1edd21cda48"
Jul 09 17:09:26.984262 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.984227    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9737d5e-7c24-4e9c-8516-dd865fee4e56" containerID="d44573ad304dbe2db5980450b9f57d8ab35a29cdfefaa41e83aa226c4742bfa2" exitCode=0
Jul 09 17:09:26.984432 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:26.984287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerDied","Data":"d44573ad304dbe2db5980450b9f57d8ab35a29cdfefaa41e83aa226c4742bfa2"}
Jul 09 17:09:27.191472 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:27.191447    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n5ct4_fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb/node-ca/0.log"
Jul 09 17:09:27.802914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:27.802874    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:27.857785 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:27.857755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:27.990058 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:27.990026    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9737d5e-7c24-4e9c-8516-dd865fee4e56" containerID="299c20e683d62b436850ca572bd9688906f44e543185614971af2b6e826f3b52" exitCode=0
Jul 09 17:09:27.990222 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:27.990082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerDied","Data":"299c20e683d62b436850ca572bd9688906f44e543185614971af2b6e826f3b52"}
Jul 09 17:09:28.142769 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.142744    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeReady"
Jul 09 17:09:28.142944 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.142892    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 17:09:28.186706 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.186672    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5jnqv"]
Jul 09 17:09:28.202961 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.202935    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jnqv"
Jul 09 17:09:28.203136 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.202930    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xmd4c"]
Jul 09 17:09:28.205444 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.205415    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 17:09:28.205721 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.205704    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 17:09:28.206053 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.206029    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 17:09:28.206268 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.206249    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fb8qb\""
Jul 09 17:09:28.212781 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.212762    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jnqv"]
Jul 09 17:09:28.212886 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.212796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xmd4c"]
Jul 09 17:09:28.212886 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.212844    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gb84w"]
Jul 09 17:09:28.212966 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.212896    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.215095 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.215071    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 17:09:28.215232 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.215132    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 17:09:28.215232 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.215222    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 17:09:28.215381 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.215364    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 17:09:28.215445 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.215363    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ppxkf\""
Jul 09 17:09:28.228775 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.228745    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gb84w"]
Jul 09 17:09:28.228970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.228866    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.231311 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.231287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 17:09:28.231435 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.231317    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjrs9\""
Jul 09 17:09:28.231435 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.231294    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 17:09:28.368349 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39c27eb5-ff3b-432e-99ea-98c723fdd12a-cert\") pod \"ingress-canary-5jnqv\" (UID: \"39c27eb5-ff3b-432e-99ea-98c723fdd12a\") " pod="openshift-ingress-canary/ingress-canary-5jnqv"
Jul 09 17:09:28.368349 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldng4\" (UniqueName: \"kubernetes.io/projected/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-api-access-ldng4\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.368349 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xf8\" (UniqueName: \"kubernetes.io/projected/39c27eb5-ff3b-432e-99ea-98c723fdd12a-kube-api-access-b8xf8\") pod \"ingress-canary-5jnqv\" (UID: \"39c27eb5-ff3b-432e-99ea-98c723fdd12a\") " pod="openshift-ingress-canary/ingress-canary-5jnqv"
Jul 09 17:09:28.368588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ac1954-aca3-4057-8b4b-40be4545d6ca-tmp-dir\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.368588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.368588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl6g6\" (UniqueName: \"kubernetes.io/projected/60ac1954-aca3-4057-8b4b-40be4545d6ca-kube-api-access-jl6g6\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.368588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0399c2f6-c71b-4c2c-8205-dede07dbc90c-data-volume\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.368588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60ac1954-aca3-4057-8b4b-40be4545d6ca-config-volume\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.368588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.368588 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.368839 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.368609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0399c2f6-c71b-4c2c-8205-dede07dbc90c-crio-socket\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.469590 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.469554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ac1954-aca3-4057-8b4b-40be4545d6ca-tmp-dir\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.469590 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.469593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.469855 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.469616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl6g6\" (UniqueName: \"kubernetes.io/projected/60ac1954-aca3-4057-8b4b-40be4545d6ca-kube-api-access-jl6g6\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.469855 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.469637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0399c2f6-c71b-4c2c-8205-dede07dbc90c-data-volume\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.469855 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.469743    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:09:28.469855 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.469756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60ac1954-aca3-4057-8b4b-40be4545d6ca-config-volume\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.469855 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.469836    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls podName:0399c2f6-c71b-4c2c-8205-dede07dbc90c nodeName:}" failed. No retries permitted until 2026-07-09 17:09:28.969790859 +0000 UTC m=+38.677003798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xmd4c" (UID: "0399c2f6-c71b-4c2c-8205-dede07dbc90c") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.469886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.469919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.469974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0399c2f6-c71b-4c2c-8205-dede07dbc90c-crio-socket\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.470000    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.470017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39c27eb5-ff3b-432e-99ea-98c723fdd12a-cert\") pod \"ingress-canary-5jnqv\" (UID: \"39c27eb5-ff3b-432e-99ea-98c723fdd12a\") " pod="openshift-ingress-canary/ingress-canary-5jnqv"
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.470024    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0399c2f6-c71b-4c2c-8205-dede07dbc90c-data-volume\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.470049    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls podName:60ac1954-aca3-4057-8b4b-40be4545d6ca nodeName:}" failed. No retries permitted until 2026-07-09 17:09:28.970034301 +0000 UTC m=+38.677247239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls") pod "dns-default-gb84w" (UID: "60ac1954-aca3-4057-8b4b-40be4545d6ca") : secret "dns-default-metrics-tls" not found
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.470050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ac1954-aca3-4057-8b4b-40be4545d6ca-tmp-dir\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.470000    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.470073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldng4\" (UniqueName: \"kubernetes.io/projected/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-api-access-ldng4\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.470116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.470116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xf8\" (UniqueName: \"kubernetes.io/projected/39c27eb5-ff3b-432e-99ea-98c723fdd12a-kube-api-access-b8xf8\") pod \"ingress-canary-5jnqv\" (UID: \"39c27eb5-ff3b-432e-99ea-98c723fdd12a\") " pod="openshift-ingress-canary/ingress-canary-5jnqv"
Jul 09 17:09:28.470539 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.470134    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-rbac-proxy-cm podName:0399c2f6-c71b-4c2c-8205-dede07dbc90c nodeName:}" failed. No retries permitted until 2026-07-09 17:09:28.970120374 +0000 UTC m=+38.677333320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xmd4c" (UID: "0399c2f6-c71b-4c2c-8205-dede07dbc90c") : configmap "kube-rbac-proxy" not found
Jul 09 17:09:28.470539 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.470214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0399c2f6-c71b-4c2c-8205-dede07dbc90c-crio-socket\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.470539 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.470380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60ac1954-aca3-4057-8b4b-40be4545d6ca-config-volume\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.473802 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.473782    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39c27eb5-ff3b-432e-99ea-98c723fdd12a-cert\") pod \"ingress-canary-5jnqv\" (UID: \"39c27eb5-ff3b-432e-99ea-98c723fdd12a\") " pod="openshift-ingress-canary/ingress-canary-5jnqv"
Jul 09 17:09:28.481011 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.480975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldng4\" (UniqueName: \"kubernetes.io/projected/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-api-access-ldng4\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.481156 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.481018    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl6g6\" (UniqueName: \"kubernetes.io/projected/60ac1954-aca3-4057-8b4b-40be4545d6ca-kube-api-access-jl6g6\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.481156 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.481143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xf8\" (UniqueName: \"kubernetes.io/projected/39c27eb5-ff3b-432e-99ea-98c723fdd12a-kube-api-access-b8xf8\") pod \"ingress-canary-5jnqv\" (UID: \"39c27eb5-ff3b-432e-99ea-98c723fdd12a\") " pod="openshift-ingress-canary/ingress-canary-5jnqv"
Jul 09 17:09:28.513619 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.513581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jnqv"
Jul 09 17:09:28.709317 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.709116    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:28.717874 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.717843    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jnqv"]
Jul 09 17:09:28.721539 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:28.721504    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c27eb5_ff3b_432e_99ea_98c723fdd12a.slice/crio-4f4c96495b4bba60f3d8daa6704826fc43612f71fc9d4ed90a9aea5701064609 WatchSource:0}: Error finding container 4f4c96495b4bba60f3d8daa6704826fc43612f71fc9d4ed90a9aea5701064609: Status 404 returned error can't find the container with id 4f4c96495b4bba60f3d8daa6704826fc43612f71fc9d4ed90a9aea5701064609
Jul 09 17:09:28.809278 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.809239    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:28.809891 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.809238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:28.809891 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.809238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:28.813630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.813560    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 17:09:28.814048 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.814027    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w62rb\""
Jul 09 17:09:28.814155 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.814122    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x7mzk\""
Jul 09 17:09:28.814442 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.814422    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 17:09:28.814583 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.814570    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 17:09:28.814751 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.814733    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 17:09:28.838911 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.838881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:28.974929 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.974833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:28.974929 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.974891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.975146 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.974936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.975146 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.974934    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:09:28.975146 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.975025    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls podName:60ac1954-aca3-4057-8b4b-40be4545d6ca nodeName:}" failed. No retries permitted until 2026-07-09 17:09:29.975011969 +0000 UTC m=+39.682224894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls") pod "dns-default-gb84w" (UID: "60ac1954-aca3-4057-8b4b-40be4545d6ca") : secret "dns-default-metrics-tls" not found
Jul 09 17:09:28.975146 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.975054    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:09:28.975146 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:28.975119    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls podName:0399c2f6-c71b-4c2c-8205-dede07dbc90c nodeName:}" failed. No retries permitted until 2026-07-09 17:09:29.975099538 +0000 UTC m=+39.682312465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xmd4c" (UID: "0399c2f6-c71b-4c2c-8205-dede07dbc90c") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:09:28.975503 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.975459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0399c2f6-c71b-4c2c-8205-dede07dbc90c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:28.993534 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.993502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jnqv" event={"ID":"39c27eb5-ff3b-432e-99ea-98c723fdd12a","Type":"ContainerStarted","Data":"4f4c96495b4bba60f3d8daa6704826fc43612f71fc9d4ed90a9aea5701064609"}
Jul 09 17:09:28.996801 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:28.996775    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w62z5" event={"ID":"e9737d5e-7c24-4e9c-8516-dd865fee4e56","Type":"ContainerStarted","Data":"294aba3436fc0e97cc5983134be985e51a9df139b85d4afad986e44090c057e4"}
Jul 09 17:09:29.019471 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:29.019420    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w62z5" podStartSLOduration=7.917928657 podStartE2EDuration="38.019405719s" totalImagesPullingTime="30.101477062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:29.01852011 +0000 UTC m=+38.725733077" watchObservedRunningTime="2026-07-09 17:09:29.019405719 +0000 UTC m=+38.726618664"
Jul 09 17:09:29.600962 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:29.600926    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:29.703496 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:29.703460    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:29.803603 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:29.803553    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:29.983280 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:29.983198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:29.983715 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:29.983285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:29.983715 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:29.983346    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:09:29.983715 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:29.983366    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:09:29.983715 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:29.983419    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls podName:0399c2f6-c71b-4c2c-8205-dede07dbc90c nodeName:}" failed. No retries permitted until 2026-07-09 17:09:31.9834041 +0000 UTC m=+41.690617032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xmd4c" (UID: "0399c2f6-c71b-4c2c-8205-dede07dbc90c") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:09:29.983715 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:29.983433    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls podName:60ac1954-aca3-4057-8b4b-40be4545d6ca nodeName:}" failed. No retries permitted until 2026-07-09 17:09:31.983427665 +0000 UTC m=+41.690640588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls") pod "dns-default-gb84w" (UID: "60ac1954-aca3-4057-8b4b-40be4545d6ca") : secret "dns-default-metrics-tls" not found
Jul 09 17:09:30.064728 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:30.064699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:30.166805 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:30.166763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:30.265666 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:30.265633    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:30.325445 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:30.325408    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:31.113885 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:31.113849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:31.504927 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:31.504868    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:31.694733 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:31.694702    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:32.001159 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:32.000976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:32.001159 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:32.001142    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:09:32.001390 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:32.001196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:32.001390 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:32.001262    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls podName:0399c2f6-c71b-4c2c-8205-dede07dbc90c nodeName:}" failed. No retries permitted until 2026-07-09 17:09:36.001246074 +0000 UTC m=+45.708458997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xmd4c" (UID: "0399c2f6-c71b-4c2c-8205-dede07dbc90c") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:09:32.001390 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:32.001281    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:09:32.001390 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:09:32.001327    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls podName:60ac1954-aca3-4057-8b4b-40be4545d6ca nodeName:}" failed. No retries permitted until 2026-07-09 17:09:36.00131453 +0000 UTC m=+45.708527454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls") pod "dns-default-gb84w" (UID: "60ac1954-aca3-4057-8b4b-40be4545d6ca") : secret "dns-default-metrics-tls" not found
Jul 09 17:09:32.005538 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:32.005511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jnqv" event={"ID":"39c27eb5-ff3b-432e-99ea-98c723fdd12a","Type":"ContainerStarted","Data":"dd3621a41976be72cab0d06a435bc501cb2c70ed10450e138bca3855760d2dc9"}
Jul 09 17:09:32.020971 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:32.020919    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5jnqv" podStartSLOduration=0.87962814 podStartE2EDuration="4.020899153s" totalImagesPullingTime="3.141271013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:32.020556659 +0000 UTC m=+41.727769606" watchObservedRunningTime="2026-07-09 17:09:32.020899153 +0000 UTC m=+41.728112103"
Jul 09 17:09:32.099828 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:32.099784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:32.166111 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:32.166032    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:32.697188 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:32.697153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:33.324362 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:33.324327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:33.423682 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:33.423644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:33.524362 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:33.524330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:33.893749 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:33.893718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:34.096207 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:34.096173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:34.148500 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:34.148415    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:34.491778 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:34.491751    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:35.099727 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:35.099671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:35.199501 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:35.199470    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:35.249528 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:35.249496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:35.493828 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:35.493794    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:35.891436 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:35.891359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:36.029711 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.029674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:36.029894 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.029737    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:36.033830 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.033777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0399c2f6-c71b-4c2c-8205-dede07dbc90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xmd4c\" (UID: \"0399c2f6-c71b-4c2c-8205-dede07dbc90c\") " pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:36.033830 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.033777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60ac1954-aca3-4057-8b4b-40be4545d6ca-metrics-tls\") pod \"dns-default-gb84w\" (UID: \"60ac1954-aca3-4057-8b4b-40be4545d6ca\") " pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:36.037728 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.037700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:36.085144 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.085104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:36.152473 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.152237    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:36.208197 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.208140    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gb84w"]
Jul 09 17:09:36.212002 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:36.211974    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ac1954_aca3_4057_8b4b_40be4545d6ca.slice/crio-36ac19d302606302cc193d3886668a863477bbbd46772e576306ce09a18ab9e2 WatchSource:0}: Error finding container 36ac19d302606302cc193d3886668a863477bbbd46772e576306ce09a18ab9e2: Status 404 returned error can't find the container with id 36ac19d302606302cc193d3886668a863477bbbd46772e576306ce09a18ab9e2
Jul 09 17:09:36.321783 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.321747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xmd4c"
Jul 09 17:09:36.461844 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.461796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xmd4c"]
Jul 09 17:09:36.465033 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:36.465005    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0399c2f6_c71b_4c2c_8205_dede07dbc90c.slice/crio-3d993310ce3988bd8ff596928ef0a6e4d35398a0bc302e7acc38cf68c64270e2 WatchSource:0}: Error finding container 3d993310ce3988bd8ff596928ef0a6e4d35398a0bc302e7acc38cf68c64270e2: Status 404 returned error can't find the container with id 3d993310ce3988bd8ff596928ef0a6e4d35398a0bc302e7acc38cf68c64270e2
Jul 09 17:09:36.491142 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:36.491110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:37.017280 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:37.017244    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gb84w" event={"ID":"60ac1954-aca3-4057-8b4b-40be4545d6ca","Type":"ContainerStarted","Data":"36ac19d302606302cc193d3886668a863477bbbd46772e576306ce09a18ab9e2"}
Jul 09 17:09:37.018359 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:37.018337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xmd4c" event={"ID":"0399c2f6-c71b-4c2c-8205-dede07dbc90c","Type":"ContainerStarted","Data":"3d993310ce3988bd8ff596928ef0a6e4d35398a0bc302e7acc38cf68c64270e2"}
Jul 09 17:09:37.058229 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:37.058196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:37.157775 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:37.157727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:37.493690 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:37.493621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:37.927766 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:37.927681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:38.190445 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:38.190356    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:38.291632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:38.291591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:38.345380 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:38.345345    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:38.701400 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:38.701361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:38.892857 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:38.892825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:39.290208 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:39.290175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:39.902461 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:39.902428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:40.090999 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:40.090960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:40.377874 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:40.377788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:40.595478 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:40.595388    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:42.033796 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:42.033752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xmd4c" event={"ID":"0399c2f6-c71b-4c2c-8205-dede07dbc90c","Type":"ContainerStarted","Data":"c7c6538583636d0f95c663fb483c1b0f2b4b96c8a0d701b9d8ff921147ca6f14"}
Jul 09 17:09:42.035573 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:42.035539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gb84w" event={"ID":"60ac1954-aca3-4057-8b4b-40be4545d6ca","Type":"ContainerStarted","Data":"86caa2ce22acb52ff3cda2005d5fca73ced230a20a508072008a6a0acca1e4fc"}
Jul 09 17:09:42.035710 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:42.035591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gb84w" event={"ID":"60ac1954-aca3-4057-8b4b-40be4545d6ca","Type":"ContainerStarted","Data":"056048b38725a4a8fab9a3652f9f5ff00398f687b571677239a0c104c8f981bf"}
Jul 09 17:09:42.035710 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:42.035634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:42.052696 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:42.052644    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gb84w" podStartSLOduration=8.905162094 podStartE2EDuration="14.052628996s" totalImagesPullingTime="5.147466902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:42.051091683 +0000 UTC m=+51.758304641" watchObservedRunningTime="2026-07-09 17:09:42.052628996 +0000 UTC m=+51.759841942"
Jul 09 17:09:44.042621 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:44.042587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xmd4c" event={"ID":"0399c2f6-c71b-4c2c-8205-dede07dbc90c","Type":"ContainerStarted","Data":"be3906970f52525c7baf719a9c25f5cc404610b806fb59dcbdd333d7aa680138"}
Jul 09 17:09:46.370450 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.370416    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"]
Jul 09 17:09:46.374432 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.374395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"
Jul 09 17:09:46.374833 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.374771    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"]
Jul 09 17:09:46.376723 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.376699    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fngqj\""
Jul 09 17:09:46.376941 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.376921    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 17:09:46.377679 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.377657    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 17:09:46.377784 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.377694    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 17:09:46.377916 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.377859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"]
Jul 09 17:09:46.378012 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.377995    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 17:09:46.378069 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.378002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.380308 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.380264    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 17:09:46.380418 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.380370    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 17:09:46.380418 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.380394    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 17:09:46.381111 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.380698    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 17:09:46.381397 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.381380    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.383429 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.383411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 17:09:46.385379 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.385355    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"]
Jul 09 17:09:46.388897 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.388805    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"]
Jul 09 17:09:46.391699 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.391656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"]
Jul 09 17:09:46.402074 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-hub\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.402074 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f55216e-1563-4187-897d-b5a83b6721e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.402302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.402302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.402302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl4mx\" (UniqueName: \"kubernetes.io/projected/7f55216e-1563-4187-897d-b5a83b6721e6-kube-api-access-dl4mx\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.402302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f55216e-1563-4187-897d-b5a83b6721e6-tmp\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.402302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.402529 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402324    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqp5c\" (UniqueName: \"kubernetes.io/projected/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-kube-api-access-rqp5c\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.402529 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f77c4d47-5482-49d7-b51a-584c65e18e65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4dd6b6d-p86rj\" (UID: \"f77c4d47-5482-49d7-b51a-584c65e18e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"
Jul 09 17:09:46.402529 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402381    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm4g4\" (UniqueName: \"kubernetes.io/projected/f77c4d47-5482-49d7-b51a-584c65e18e65-kube-api-access-gm4g4\") pod \"managed-serviceaccount-addon-agent-f4dd6b6d-p86rj\" (UID: \"f77c4d47-5482-49d7-b51a-584c65e18e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"
Jul 09 17:09:46.402529 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.402419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-ca\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.480248 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.480217    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7899897b97-hgcw2"]
Jul 09 17:09:46.481492 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.481451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:46.485146 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.485127    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.487329 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.487292    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 17:09:46.487731 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.487709    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f62bf\""
Jul 09 17:09:46.487885 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.487761    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 17:09:46.487948 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.487891    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 17:09:46.492690 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.492665    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 17:09:46.496377 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.496345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7899897b97-hgcw2"]
Jul 09 17:09:46.503197 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm4g4\" (UniqueName: \"kubernetes.io/projected/f77c4d47-5482-49d7-b51a-584c65e18e65-kube-api-access-gm4g4\") pod \"managed-serviceaccount-addon-agent-f4dd6b6d-p86rj\" (UID: \"f77c4d47-5482-49d7-b51a-584c65e18e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"
Jul 09 17:09:46.503197 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f55216e-1563-4187-897d-b5a83b6721e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.503440 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2747e923-bf69-4f1f-8e62-31796c4bf014-registry-certificates\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.503440 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-ca\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.503440 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2747e923-bf69-4f1f-8e62-31796c4bf014-installation-pull-secrets\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.503702 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.503702 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl4mx\" (UniqueName: \"kubernetes.io/projected/7f55216e-1563-4187-897d-b5a83b6721e6-kube-api-access-dl4mx\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.503702 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xpj\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-kube-api-access-v2xpj\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.503702 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.503940 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-registry-tls\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.503940 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2747e923-bf69-4f1f-8e62-31796c4bf014-image-registry-private-configuration\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.503940 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f77c4d47-5482-49d7-b51a-584c65e18e65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4dd6b6d-p86rj\" (UID: \"f77c4d47-5482-49d7-b51a-584c65e18e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"
Jul 09 17:09:46.503940 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.503859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-hub\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.504920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.504138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.504920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.504175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f55216e-1563-4187-897d-b5a83b6721e6-tmp\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.504920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.504217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-bound-sa-token\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.504920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.504248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2747e923-bf69-4f1f-8e62-31796c4bf014-trusted-ca\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.504920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.504277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2747e923-bf69-4f1f-8e62-31796c4bf014-ca-trust-extracted\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.504920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.504314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqp5c\" (UniqueName: \"kubernetes.io/projected/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-kube-api-access-rqp5c\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.504920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.504902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.505526 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.505270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f55216e-1563-4187-897d-b5a83b6721e6-tmp\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.507912 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.507882    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.508008 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.507933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-ca\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.508138 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.508101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f55216e-1563-4187-897d-b5a83b6721e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.508138 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.508118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f77c4d47-5482-49d7-b51a-584c65e18e65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f4dd6b6d-p86rj\" (UID: \"f77c4d47-5482-49d7-b51a-584c65e18e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"
Jul 09 17:09:46.508536 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.508518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.509757 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.509736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-hub\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.515567 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.515531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqp5c\" (UniqueName: \"kubernetes.io/projected/a2fedb3b-cccb-486c-9289-5ffdab4edf6b-kube-api-access-rqp5c\") pod \"cluster-proxy-proxy-agent-64db7fb8d5-zx4vq\" (UID: \"a2fedb3b-cccb-486c-9289-5ffdab4edf6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.515722 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.515623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm4g4\" (UniqueName: \"kubernetes.io/projected/f77c4d47-5482-49d7-b51a-584c65e18e65-kube-api-access-gm4g4\") pod \"managed-serviceaccount-addon-agent-f4dd6b6d-p86rj\" (UID: \"f77c4d47-5482-49d7-b51a-584c65e18e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"
Jul 09 17:09:46.516470 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.516449    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl4mx\" (UniqueName: \"kubernetes.io/projected/7f55216e-1563-4187-897d-b5a83b6721e6-kube-api-access-dl4mx\") pod \"klusterlet-addon-workmgr-68b7c5dcb7-srwct\" (UID: \"7f55216e-1563-4187-897d-b5a83b6721e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.577601 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.577569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:46.604863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.604802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-registry-tls\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.604863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.604875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2747e923-bf69-4f1f-8e62-31796c4bf014-image-registry-private-configuration\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.605132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.604944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-bound-sa-token\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.605132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.604968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2747e923-bf69-4f1f-8e62-31796c4bf014-trusted-ca\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.605132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.604993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2747e923-bf69-4f1f-8e62-31796c4bf014-ca-trust-extracted\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.605132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.605034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2747e923-bf69-4f1f-8e62-31796c4bf014-registry-certificates\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.605132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.605071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2747e923-bf69-4f1f-8e62-31796c4bf014-installation-pull-secrets\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.605132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.605101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xpj\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-kube-api-access-v2xpj\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.605682 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.605653    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2747e923-bf69-4f1f-8e62-31796c4bf014-ca-trust-extracted\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.606114 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.606065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2747e923-bf69-4f1f-8e62-31796c4bf014-registry-certificates\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.606355 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.606328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2747e923-bf69-4f1f-8e62-31796c4bf014-trusted-ca\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.607875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.607850    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2747e923-bf69-4f1f-8e62-31796c4bf014-image-registry-private-configuration\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.608000 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.607978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-registry-tls\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.608151 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.608133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2747e923-bf69-4f1f-8e62-31796c4bf014-installation-pull-secrets\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.614658 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.614627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-bound-sa-token\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.615028 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.615004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xpj\" (UniqueName: \"kubernetes.io/projected/2747e923-bf69-4f1f-8e62-31796c4bf014-kube-api-access-v2xpj\") pod \"image-registry-7899897b97-hgcw2\" (UID: \"2747e923-bf69-4f1f-8e62-31796c4bf014\") " pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:46.673881 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.673776    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:46.698351 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.698301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"
Jul 09 17:09:46.705980 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.705949    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"
Jul 09 17:09:46.714048 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.714016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:46.808619 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:46.808581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:47.049349 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:47.049313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:47.281383 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:47.281348    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"]
Jul 09 17:09:47.284878 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:47.284849    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f55216e_1563_4187_897d_b5a83b6721e6.slice/crio-6f2d2e36fab865bc163f9a75f52e80e08fe937255a21b84d3a72d9076fd82689 WatchSource:0}: Error finding container 6f2d2e36fab865bc163f9a75f52e80e08fe937255a21b84d3a72d9076fd82689: Status 404 returned error can't find the container with id 6f2d2e36fab865bc163f9a75f52e80e08fe937255a21b84d3a72d9076fd82689
Jul 09 17:09:47.513118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:47.513081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq"]
Jul 09 17:09:47.516149 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:47.516120    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj"]
Jul 09 17:09:47.516875 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:47.516849    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2fedb3b_cccb_486c_9289_5ffdab4edf6b.slice/crio-6f4c1ec50418004b306ce940f41a7965542c1b0a9ab210d3a95f3065dc619986 WatchSource:0}: Error finding container 6f4c1ec50418004b306ce940f41a7965542c1b0a9ab210d3a95f3065dc619986: Status 404 returned error can't find the container with id 6f4c1ec50418004b306ce940f41a7965542c1b0a9ab210d3a95f3065dc619986
Jul 09 17:09:47.518712 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:47.518651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7899897b97-hgcw2"]
Jul 09 17:09:47.520112 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:47.520082    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf77c4d47_5482_49d7_b51a_584c65e18e65.slice/crio-d44003a1033b81ff2060b3e613192b64042a8c776386d55f6ef3f9520323d9c3 WatchSource:0}: Error finding container d44003a1033b81ff2060b3e613192b64042a8c776386d55f6ef3f9520323d9c3: Status 404 returned error can't find the container with id d44003a1033b81ff2060b3e613192b64042a8c776386d55f6ef3f9520323d9c3
Jul 09 17:09:47.522643 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:47.522609    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2747e923_bf69_4f1f_8e62_31796c4bf014.slice/crio-f3f5d437e909659ca0da1aff01e125be9aa97b61129a3acf76304f8a8a9f7c30 WatchSource:0}: Error finding container f3f5d437e909659ca0da1aff01e125be9aa97b61129a3acf76304f8a8a9f7c30: Status 404 returned error can't find the container with id f3f5d437e909659ca0da1aff01e125be9aa97b61129a3acf76304f8a8a9f7c30
Jul 09 17:09:47.591964 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:47.591929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:48.057372 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.057276    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xmd4c" event={"ID":"0399c2f6-c71b-4c2c-8205-dede07dbc90c","Type":"ContainerStarted","Data":"05247cd7757791b2bc352739b9102d9b777752dc338fad45eb951b16019e93c7"}
Jul 09 17:09:48.059109 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.059045    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj" event={"ID":"f77c4d47-5482-49d7-b51a-584c65e18e65","Type":"ContainerStarted","Data":"d44003a1033b81ff2060b3e613192b64042a8c776386d55f6ef3f9520323d9c3"}
Jul 09 17:09:48.060708 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.060620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq" event={"ID":"a2fedb3b-cccb-486c-9289-5ffdab4edf6b","Type":"ContainerStarted","Data":"6f4c1ec50418004b306ce940f41a7965542c1b0a9ab210d3a95f3065dc619986"}
Jul 09 17:09:48.063339 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.063307    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7899897b97-hgcw2" event={"ID":"2747e923-bf69-4f1f-8e62-31796c4bf014","Type":"ContainerStarted","Data":"4cd9cca2d03bd9ef91e8bbd6fa8f569cc7a95dc8bf054a158c5589cc40ddaf52"}
Jul 09 17:09:48.063463 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.063359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7899897b97-hgcw2" event={"ID":"2747e923-bf69-4f1f-8e62-31796c4bf014","Type":"ContainerStarted","Data":"f3f5d437e909659ca0da1aff01e125be9aa97b61129a3acf76304f8a8a9f7c30"}
Jul 09 17:09:48.063598 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.063579    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:09:48.065041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.065005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct" event={"ID":"7f55216e-1563-4187-897d-b5a83b6721e6","Type":"ContainerStarted","Data":"6f2d2e36fab865bc163f9a75f52e80e08fe937255a21b84d3a72d9076fd82689"}
Jul 09 17:09:48.075215 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.075126    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xmd4c" podStartSLOduration=9.555793235 podStartE2EDuration="20.075102246s" totalImagesPullingTime="10.519309011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:09:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:48.073777329 +0000 UTC m=+57.780990302" watchObservedRunningTime="2026-07-09 17:09:48.075102246 +0000 UTC m=+57.782315192"
Jul 09 17:09:48.091856 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.091773    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7899897b97-hgcw2" podStartSLOduration=2.091755722 podStartE2EDuration="2.091755722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:48.091456091 +0000 UTC m=+57.798669035" watchObservedRunningTime="2026-07-09 17:09:48.091755722 +0000 UTC m=+57.798968669"
Jul 09 17:09:48.585674 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.585558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:48.638891 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:48.638784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:51.078926 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:51.078881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj" event={"ID":"f77c4d47-5482-49d7-b51a-584c65e18e65","Type":"ContainerStarted","Data":"de721a198018fc7826618a290865f774845ce2b469db519b89b3bc4a649f97c8"}
Jul 09 17:09:51.096931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:51.096869    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f4dd6b6d-p86rj" podStartSLOduration=2.042270062 podStartE2EDuration="5.096850401s" totalImagesPullingTime="3.054580339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:51.09552694 +0000 UTC m=+60.802739888" watchObservedRunningTime="2026-07-09 17:09:51.096850401 +0000 UTC m=+60.804063346"
Jul 09 17:09:51.537625 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:51.537585    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:51.638306 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:51.638250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:52.041132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:52.041097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gb84w"
Jul 09 17:09:52.055822 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:52.055786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:52.155936 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:52.155877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:52.769851 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:52.769801    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:52.871957 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:52.871919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:52.940184 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:52.940129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:53.270039 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:53.270004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:53.985797 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:53.985719    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76nj5"
Jul 09 17:09:54.093614 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.093578    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq" event={"ID":"a2fedb3b-cccb-486c-9289-5ffdab4edf6b","Type":"ContainerStarted","Data":"d6667c56a562465eee9ef3121b1ec01f8b97a7f0219f5a9702cea139223ce4ab"}
Jul 09 17:09:54.093848 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.093625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq" event={"ID":"a2fedb3b-cccb-486c-9289-5ffdab4edf6b","Type":"ContainerStarted","Data":"a1722c966a10021c4c7e36e77114cc09a2ac1efaa60e44ecf5a9ed94c7ff104e"}
Jul 09 17:09:54.093848 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.093643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq" event={"ID":"a2fedb3b-cccb-486c-9289-5ffdab4edf6b","Type":"ContainerStarted","Data":"dcc596b76c9c84eb21917a551c6ca7c73044bc86ba0369eef87c0c9fd8c49c79"}
Jul 09 17:09:54.098954 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.098918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct" event={"ID":"7f55216e-1563-4187-897d-b5a83b6721e6","Type":"ContainerStarted","Data":"480522c9bf922f5b046b23716f6bda51c631996e361c76311674fc13cae969a6"}
Jul 09 17:09:54.099125 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.099093    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:54.100801 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.100773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct"
Jul 09 17:09:54.116184 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.116115    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db7fb8d5-zx4vq" podStartSLOduration=1.9136893590000001 podStartE2EDuration="8.116097394s" totalImagesPullingTime="6.202408035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:54.11543378 +0000 UTC m=+63.822646747" watchObservedRunningTime="2026-07-09 17:09:54.116097394 +0000 UTC m=+63.823310341"
Jul 09 17:09:54.131645 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.131614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:54.164365 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.164309    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68b7c5dcb7-srwct" podStartSLOduration=1.732142422 podStartE2EDuration="8.164289909s" totalImagesPullingTime="6.432147487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:54.163328307 +0000 UTC m=+63.870541277" watchObservedRunningTime="2026-07-09 17:09:54.164289909 +0000 UTC m=+63.871502855"
Jul 09 17:09:54.244296 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.244263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:54.345380 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.345346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:54.450158 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.450115    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:54.826871 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.826837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:54.944119 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:54.944085    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:55.221965 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:55.221883    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:55.277018 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:55.276992    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:55.652717 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:55.652685    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:55.707869 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:55.707842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:55.930114 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:55.930024    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:55.985078 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:55.985050    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:56.052279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.052232    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:56.328323 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.328292    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:56.595202 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.595109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:56.595202 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.595153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:56.597544 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.597522    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 17:09:56.597677 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.597522    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 17:09:56.607634 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.607599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4557ec4-4b4f-41ec-9926-be1e9fb7948e-metrics-certs\") pod \"network-metrics-daemon-l28vt\" (UID: \"c4557ec4-4b4f-41ec-9926-be1e9fb7948e\") " pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:56.607754 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.607637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f54b4f19-62e8-4495-ae0e-a62f938f7436-original-pull-secret\") pod \"global-pull-secret-syncer-jt9kd\" (UID: \"f54b4f19-62e8-4495-ae0e-a62f938f7436\") " pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:56.696296 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.696256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:56.698943 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.698919    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 17:09:56.709146 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.709119    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 17:09:56.720129 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.720104    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzfv\" (UniqueName: \"kubernetes.io/projected/275abdc9-eb22-47eb-ad33-a1edd21cda48-kube-api-access-4gzfv\") pod \"network-check-target-vzmg6\" (UID: \"275abdc9-eb22-47eb-ad33-a1edd21cda48\") " pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:56.725076 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.725053    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x7mzk\""
Jul 09 17:09:56.730685 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.730662    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w62rb\""
Jul 09 17:09:56.733300 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.733282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l28vt"
Jul 09 17:09:56.733414 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.733398    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jt9kd"
Jul 09 17:09:56.739548 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.739522    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:09:56.852294 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.852117    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:56.907783 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.907750    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l28vt"]
Jul 09 17:09:56.911909 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:56.911869    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4557ec4_4b4f_41ec_9926_be1e9fb7948e.slice/crio-62927bbc47703855e2f1a978bee7c45e5bbfb0547e1e2ad444e1d066c11d5820 WatchSource:0}: Error finding container 62927bbc47703855e2f1a978bee7c45e5bbfb0547e1e2ad444e1d066c11d5820: Status 404 returned error can't find the container with id 62927bbc47703855e2f1a978bee7c45e5bbfb0547e1e2ad444e1d066c11d5820
Jul 09 17:09:56.944309 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.944275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jt9kd"]
Jul 09 17:09:56.947548 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:56.947516    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54b4f19_62e8_4495_ae0e_a62f938f7436.slice/crio-017a6e28f35ee84ce58f35569a84ab18c7aec48f9d7b8def8b00815442fda83f WatchSource:0}: Error finding container 017a6e28f35ee84ce58f35569a84ab18c7aec48f9d7b8def8b00815442fda83f: Status 404 returned error can't find the container with id 017a6e28f35ee84ce58f35569a84ab18c7aec48f9d7b8def8b00815442fda83f
Jul 09 17:09:56.968838 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:56.968791    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vzmg6"]
Jul 09 17:09:56.972028 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:09:56.972003    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275abdc9_eb22_47eb_ad33_a1edd21cda48.slice/crio-e24b4d2192d86ca4e9271ad806ae755cebeb56765a4d3994305356f6b763a0d5 WatchSource:0}: Error finding container e24b4d2192d86ca4e9271ad806ae755cebeb56765a4d3994305356f6b763a0d5: Status 404 returned error can't find the container with id e24b4d2192d86ca4e9271ad806ae755cebeb56765a4d3994305356f6b763a0d5
Jul 09 17:09:57.110105 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:57.110010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l28vt" event={"ID":"c4557ec4-4b4f-41ec-9926-be1e9fb7948e","Type":"ContainerStarted","Data":"62927bbc47703855e2f1a978bee7c45e5bbfb0547e1e2ad444e1d066c11d5820"}
Jul 09 17:09:57.111080 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:57.111058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vzmg6" event={"ID":"275abdc9-eb22-47eb-ad33-a1edd21cda48","Type":"ContainerStarted","Data":"e24b4d2192d86ca4e9271ad806ae755cebeb56765a4d3994305356f6b763a0d5"}
Jul 09 17:09:57.112116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:57.112093    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jt9kd" event={"ID":"f54b4f19-62e8-4495-ae0e-a62f938f7436","Type":"ContainerStarted","Data":"017a6e28f35ee84ce58f35569a84ab18c7aec48f9d7b8def8b00815442fda83f"}
Jul 09 17:09:59.124722 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:59.124674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l28vt" event={"ID":"c4557ec4-4b4f-41ec-9926-be1e9fb7948e","Type":"ContainerStarted","Data":"a4f42fe55a39b4236cf4a4f7007000bd75de9e4144dade51229189c24ea8430d"}
Jul 09 17:09:59.125253 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:59.124747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l28vt" event={"ID":"c4557ec4-4b4f-41ec-9926-be1e9fb7948e","Type":"ContainerStarted","Data":"612ce0545626c987e1962f7176542d22197770d89c6dbf5f67ad2169a7747dc5"}
Jul 09 17:09:59.141116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:59.140763    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l28vt" podStartSLOduration=66.818926695 podStartE2EDuration="1m8.140740244s" totalImagesPullingTime="1.321813549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:59.139949544 +0000 UTC m=+68.847162514" watchObservedRunningTime="2026-07-09 17:09:59.140740244 +0000 UTC m=+68.847953191"
Jul 09 17:09:59.263727 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:59.263681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:59.363124 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:59.363073    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:09:59.956260 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:09:59.956156    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:00.700030 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:00.699990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:00.891107 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:00.891019    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:01.136602 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:01.136567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vzmg6" event={"ID":"275abdc9-eb22-47eb-ad33-a1edd21cda48","Type":"ContainerStarted","Data":"2b7230bc8daf7a3dc42df68fdbc71d1fec5c2659887e5e27e607cb6529803c02"}
Jul 09 17:10:01.136769 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:01.136729    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:10:01.161699 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:01.161600    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vzmg6" podStartSLOduration=66.572648402 podStartE2EDuration="1m10.161581182s" totalImagesPullingTime="3.58893278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:10:01.160846895 +0000 UTC m=+70.868059861" watchObservedRunningTime="2026-07-09 17:10:01.161581182 +0000 UTC m=+70.868794127"
Jul 09 17:10:01.199634 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:01.199596    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:01.299141 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:01.299108    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:02.983313 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:02.983278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:03.084335 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:03.084304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:03.144575 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:03.144539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jt9kd" event={"ID":"f54b4f19-62e8-4495-ae0e-a62f938f7436","Type":"ContainerStarted","Data":"8a823ff43946ae3081be452a2ff23c5b18f47365e9b724dabae31ab7b3ea89b8"}
Jul 09 17:10:03.160011 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:03.159945    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jt9kd" podStartSLOduration=66.746747743 podStartE2EDuration="1m12.159871724s" totalImagesPullingTime="5.413123981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:10:03.159122444 +0000 UTC m=+72.866335409" watchObservedRunningTime="2026-07-09 17:10:03.159871724 +0000 UTC m=+72.867084669"
Jul 09 17:10:03.199112 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:03.199086    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:04.527465 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:04.527433    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:06.041744 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:06.041712    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:07.042305 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.042272    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:07.142180 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.142148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:07.323073 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.322986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:07.377523 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.377488    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fmlct"]
Jul 09 17:10:07.380581 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.380562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.382867 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.382847    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7lwwq\""
Jul 09 17:10:07.383163 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.383143    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 17:10:07.383281 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.383232    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 17:10:07.383345 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.383300    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 17:10:07.383795 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.383776    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 17:10:07.383865 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.383851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 17:10:07.383952 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.383894    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 17:10:07.482066 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-tls\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.482066 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.482307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482103    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-root\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.482307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-sys\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.482307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-textfile\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.482307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c135eef-f0b3-478c-bc54-bc29f60d7a45-metrics-client-ca\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.482307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.482307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4td85\" (UniqueName: \"kubernetes.io/projected/4c135eef-f0b3-478c-bc54-bc29f60d7a45-kube-api-access-4td85\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.482307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.482300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-wtmp\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.582919 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.582799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-tls\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.582919 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.582880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.582919 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.582911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-root\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:10:07.582929    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.582944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-sys\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.582979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-textfile\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:10:07.583003    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-tls podName:4c135eef-f0b3-478c-bc54-bc29f60d7a45 nodeName:}" failed. No retries permitted until 2026-07-09 17:10:08.082983198 +0000 UTC m=+77.790196135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-tls") pod "node-exporter-fmlct" (UID: "4c135eef-f0b3-478c-bc54-bc29f60d7a45") : secret "node-exporter-tls" not found
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-root\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c135eef-f0b3-478c-bc54-bc29f60d7a45-metrics-client-ca\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583045    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-sys\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4td85\" (UniqueName: \"kubernetes.io/projected/4c135eef-f0b3-478c-bc54-bc29f60d7a45-kube-api-access-4td85\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-wtmp\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583709 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583260    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-wtmp\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583709 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-textfile\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583709 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:07.583709 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583691    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c135eef-f0b3-478c-bc54-bc29f60d7a45-metrics-client-ca\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.583868 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.583759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.585421 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.585400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.593755 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.593727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4td85\" (UniqueName: \"kubernetes.io/projected/4c135eef-f0b3-478c-bc54-bc29f60d7a45-kube-api-access-4td85\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:07.684917 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.684879    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:07.786769 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.786740    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:07.842231 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.842146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:07.937772 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:07.937742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:08.028701 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:08.028672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:08.088677 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:08.088640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-tls\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:08.091109 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:08.091085    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c135eef-f0b3-478c-bc54-bc29f60d7a45-node-exporter-tls\") pod \"node-exporter-fmlct\" (UID: \"4c135eef-f0b3-478c-bc54-bc29f60d7a45\") " pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:08.290609 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:08.290571    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fmlct"
Jul 09 17:10:08.302373 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:10:08.302332    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c135eef_f0b3_478c_bc54_bc29f60d7a45.slice/crio-9a04886f3dc94245c4753ac7e97a7fd7e495d6137e830c2e7dc2bb58affe42cf WatchSource:0}: Error finding container 9a04886f3dc94245c4753ac7e97a7fd7e495d6137e830c2e7dc2bb58affe42cf: Status 404 returned error can't find the container with id 9a04886f3dc94245c4753ac7e97a7fd7e495d6137e830c2e7dc2bb58affe42cf
Jul 09 17:10:08.971647 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:08.971616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:09.075305 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:09.075258    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:09.075528 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:09.075512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7899897b97-hgcw2"
Jul 09 17:10:09.184962 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:09.184929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmlct" event={"ID":"4c135eef-f0b3-478c-bc54-bc29f60d7a45","Type":"ContainerStarted","Data":"9a04886f3dc94245c4753ac7e97a7fd7e495d6137e830c2e7dc2bb58affe42cf"}
Jul 09 17:10:10.167612 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:10.167575    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:10.189914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:10.189879    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c135eef-f0b3-478c-bc54-bc29f60d7a45" containerID="ca6692e622ee2a0a3c455b00e528945f4f8b8a738106571471b19a135756c416" exitCode=0
Jul 09 17:10:10.189914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:10.189918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmlct" event={"ID":"4c135eef-f0b3-478c-bc54-bc29f60d7a45","Type":"ContainerDied","Data":"ca6692e622ee2a0a3c455b00e528945f4f8b8a738106571471b19a135756c416"}
Jul 09 17:10:10.268548 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:10.268504    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:10.369791 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:10.369753    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:11.197195 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:11.197154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmlct" event={"ID":"4c135eef-f0b3-478c-bc54-bc29f60d7a45","Type":"ContainerStarted","Data":"245738342fb8c91af8f520c3e4e3f2fe592d12fa1c75f17bfc12e8494f6c8e2e"}
Jul 09 17:10:11.197566 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:11.197214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmlct" event={"ID":"4c135eef-f0b3-478c-bc54-bc29f60d7a45","Type":"ContainerStarted","Data":"f2d5c5f039b1df91bed134702b8a5b6143be6d08766773c0800b3936ef57f19a"}
Jul 09 17:10:11.216899 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:11.216845    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fmlct" podStartSLOduration=2.734277596 podStartE2EDuration="4.216800811s" totalImagesPullingTime="1.415154127s" totalInitContainerRuntime="67.369088ms" isStatefulPod=true podCreationTimestamp="2026-07-09 17:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:10:11.2152307 +0000 UTC m=+80.922443645" watchObservedRunningTime="2026-07-09 17:10:11.216800811 +0000 UTC m=+80.924013757"
Jul 09 17:10:11.424114 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:11.424008    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:11.484591 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:11.484531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:12.135890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:12.135857    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:12.206438 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:12.206410    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:13.256694 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:13.256666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:13.311226 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:13.311202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:13.627331 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:13.627247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:14.265629 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:14.265597    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:14.323643 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:14.323614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:17.139365 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:17.139329    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:17.198293 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:17.198267    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:21.687344 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:21.687301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:21.748408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:21.748375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:22.056139 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:22.056106    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:22.156282 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:22.156249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:23.052827 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:23.052780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:23.780234 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:23.780200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:29.858500 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:29.858464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:29.959085 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:29.959048    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:32.143452 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:32.143425    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vzmg6"
Jul 09 17:10:32.259544 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:32.259507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:32.324688 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:32.324656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:37.058012 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:37.057977    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:37.122905 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:37.122876    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:41.922368 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:41.922338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:41.972392 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:41.972355    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:42.854209 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:42.854175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:42.908880 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:42.908850    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:42.963720 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:42.963686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:49.358461 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:49.358424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:49.459969 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:49.459935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:49.558287 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:49.558256    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:52.057830 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:52.057778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:10:52.109168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:10:52.109132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:08.201729 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:08.201692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:23.502961 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:23.502921    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:23.567130 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:23.567092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:24.327635 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:24.327601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:24.382661 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:24.382631    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:32.142679 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:32.142644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:35.077069 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:35.077026    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:35.177881 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:35.177847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:35.278046 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:35.278015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:35.463734 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:35.463646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:35.516229 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:35.516203    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:52.064987 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:52.064900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:11:52.161566 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:11:52.161534    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:12:13.584988 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:12:13.584945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:12:14.062674 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:12:14.062636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:12:40.818399 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:12:40.818367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:12:41.830537 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:12:41.830496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:07.549884 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:07.549842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:08.393739 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:08.393703    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:11.164465 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:11.164434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:11.262319 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:11.262243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:14.251243 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:14.251210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:14.353825 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:14.353793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:15.102413 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:15.102378    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:15.651834 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:15.651778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:15.753914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:15.753879    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:15.852142 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:15.852109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:15.959898 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:15.959795    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:16.061014 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:16.060979    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:24.494096 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:24.494062    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:27.362534 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:27.362495    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:27.459866 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:27.459833    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:29.195706 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:29.195672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:29.295141 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:29.295115    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:44.871693 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:44.871656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:46.311600 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:46.311564    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:46.957407 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:46.957378    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:47.374827 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:47.374775    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:50.683405 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:50.683379    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 17:13:58.771838 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:58.771786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:58.867464 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:58.867431    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:59.389762 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.389728    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:59.556625 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.556593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:59.654254 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.654178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:59.677654 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.677628    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"]
Jul 09 17:13:59.679873 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.679854    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.682352 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.682330    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 17:13:59.683634 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.683613    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 17:13:59.683726 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.683677    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 17:13:59.683775 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.683762    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7d59w\""
Jul 09 17:13:59.684144 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.684128    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 17:13:59.695473 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.695444    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"]
Jul 09 17:13:59.818972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.818937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9e96c9a-d706-4ade-b924-72497dc24fda-tmp\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.818972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.818988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9e96c9a-d706-4ade-b924-72497dc24fda-webhook-cert\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.819408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.819025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9e96c9a-d706-4ade-b924-72497dc24fda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.819408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.819083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9e96c9a-d706-4ade-b924-72497dc24fda-manifests\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.819408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.819143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qsmt\" (UniqueName: \"kubernetes.io/projected/e9e96c9a-d706-4ade-b924-72497dc24fda-kube-api-access-5qsmt\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.890349 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.890312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:13:59.919792 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.919702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9e96c9a-d706-4ade-b924-72497dc24fda-tmp\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.919792 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.919767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9e96c9a-d706-4ade-b924-72497dc24fda-webhook-cert\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.919792 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.919793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9e96c9a-d706-4ade-b924-72497dc24fda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.920055 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.919831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9e96c9a-d706-4ade-b924-72497dc24fda-manifests\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.920055 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.919861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qsmt\" (UniqueName: \"kubernetes.io/projected/e9e96c9a-d706-4ade-b924-72497dc24fda-kube-api-access-5qsmt\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.920258 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.920235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9e96c9a-d706-4ade-b924-72497dc24fda-manifests\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.922029 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.922007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9e96c9a-d706-4ade-b924-72497dc24fda-tmp\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.922244 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.922226    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9e96c9a-d706-4ade-b924-72497dc24fda-webhook-cert\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.922363 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.922343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9e96c9a-d706-4ade-b924-72497dc24fda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.929274 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.929247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qsmt\" (UniqueName: \"kubernetes.io/projected/e9e96c9a-d706-4ade-b924-72497dc24fda-kube-api-access-5qsmt\") pod \"opendatahub-operator-controller-manager-849f76587-74tp2\" (UID: \"e9e96c9a-d706-4ade-b924-72497dc24fda\") " pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:13:59.990479 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:13:59.990439    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:14:00.127678 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:00.127654    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"]
Jul 09 17:14:00.130427 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:14:00.130400    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e96c9a_d706_4ade_b924_72497dc24fda.slice/crio-532a901a958833a2a79f050ddcdc60698e271dae0e25d05fbec133db8adc2dc1 WatchSource:0}: Error finding container 532a901a958833a2a79f050ddcdc60698e271dae0e25d05fbec133db8adc2dc1: Status 404 returned error can't find the container with id 532a901a958833a2a79f050ddcdc60698e271dae0e25d05fbec133db8adc2dc1
Jul 09 17:14:00.132100 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:00.132083    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:14:00.243616 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:00.243584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:00.343272 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:00.343244    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:00.945038 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:00.944991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2" event={"ID":"e9e96c9a-d706-4ade-b924-72497dc24fda","Type":"ContainerStarted","Data":"532a901a958833a2a79f050ddcdc60698e271dae0e25d05fbec133db8adc2dc1"}
Jul 09 17:14:03.957676 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:03.957643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2" event={"ID":"e9e96c9a-d706-4ade-b924-72497dc24fda","Type":"ContainerStarted","Data":"de8f9a9b16cc159075b692a5e7d256f900c6d6f41b9d1780eeeda863bc0889a5"}
Jul 09 17:14:04.962594 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:04.962560    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9e96c9a-d706-4ade-b924-72497dc24fda" containerID="de8f9a9b16cc159075b692a5e7d256f900c6d6f41b9d1780eeeda863bc0889a5" exitCode=0
Jul 09 17:14:04.963001 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:04.962618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2" event={"ID":"e9e96c9a-d706-4ade-b924-72497dc24fda","Type":"ContainerDied","Data":"de8f9a9b16cc159075b692a5e7d256f900c6d6f41b9d1780eeeda863bc0889a5"}
Jul 09 17:14:05.968805 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:05.968767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2" event={"ID":"e9e96c9a-d706-4ade-b924-72497dc24fda","Type":"ContainerStarted","Data":"6a350c9d2caa9856abc42ee69398f229b4ec6fc628bcb94f15c9998a726fcc4c"}
Jul 09 17:14:05.969203 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:05.968957    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:14:05.990762 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:05.990702    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2" podStartSLOduration=2.36376299 podStartE2EDuration="6.990677365s" totalImagesPullingTime="3.589997124s" totalInitContainerRuntime="1.036917251s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:13:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:14:05.989701265 +0000 UTC m=+315.696914213" watchObservedRunningTime="2026-07-09 17:14:05.990677365 +0000 UTC m=+315.697890313"
Jul 09 17:14:07.101287 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:07.101252    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:07.202372 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:07.202337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:16.974244 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:16.974209    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-849f76587-74tp2"
Jul 09 17:14:18.825333 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:18.825299    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:18.958833 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:18.958777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:19.244602 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.244574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:19.346270 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.346239    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"]
Jul 09 17:14:19.354624 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.354588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.357734 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.357708    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 17:14:19.357913 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.357842    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 17:14:19.358755 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.358736    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 17:14:19.358846 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.358736    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 17:14:19.358846 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.358743    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vzm5x\""
Jul 09 17:14:19.361457 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.361372    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"]
Jul 09 17:14:19.462944 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.462909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tmp\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.462944 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.462950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxl8m\" (UniqueName: \"kubernetes.io/projected/491f4d3c-0ea8-4231-a7ef-3233f82282b6-kube-api-access-nxl8m\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.463174 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.462983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tls-certs\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.564353 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.564245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tls-certs\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.564353 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.564323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tmp\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.564353 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.564352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxl8m\" (UniqueName: \"kubernetes.io/projected/491f4d3c-0ea8-4231-a7ef-3233f82282b6-kube-api-access-nxl8m\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.564646 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:19.564423    2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 09 17:14:19.564646 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:19.564519    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tls-certs podName:491f4d3c-0ea8-4231-a7ef-3233f82282b6 nodeName:}" failed. No retries permitted until 2026-07-09 17:14:20.064496301 +0000 UTC m=+329.771709233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tls-certs") pod "kube-auth-proxy-77cb4ccd4b-ndxwf" (UID: "491f4d3c-0ea8-4231-a7ef-3233f82282b6") : secret "kube-auth-proxy-tls" not found
Jul 09 17:14:19.566584 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.566552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tmp\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.580180 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.580146    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxl8m\" (UniqueName: \"kubernetes.io/projected/491f4d3c-0ea8-4231-a7ef-3233f82282b6-kube-api-access-nxl8m\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:19.616142 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.616111    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hpwk"]
Jul 09 17:14:19.619256 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.619239    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:19.621985 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.621966    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-28nwn\""
Jul 09 17:14:19.622455 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.622440    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 17:14:19.647705 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.647676    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hpwk"]
Jul 09 17:14:19.677265 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.677228    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:19.745278 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.745248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:19.766428 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.766391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qg6g\" (UniqueName: \"kubernetes.io/projected/c30baf0f-3601-4dba-aef3-ab8998759c7e-kube-api-access-7qg6g\") pod \"odh-model-controller-7998c67dc4-2hpwk\" (UID: \"c30baf0f-3601-4dba-aef3-ab8998759c7e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:19.766572 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.766481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30baf0f-3601-4dba-aef3-ab8998759c7e-cert\") pod \"odh-model-controller-7998c67dc4-2hpwk\" (UID: \"c30baf0f-3601-4dba-aef3-ab8998759c7e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:19.852228 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.852138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:19.867823 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.867775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qg6g\" (UniqueName: \"kubernetes.io/projected/c30baf0f-3601-4dba-aef3-ab8998759c7e-kube-api-access-7qg6g\") pod \"odh-model-controller-7998c67dc4-2hpwk\" (UID: \"c30baf0f-3601-4dba-aef3-ab8998759c7e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:19.867947 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.867887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30baf0f-3601-4dba-aef3-ab8998759c7e-cert\") pod \"odh-model-controller-7998c67dc4-2hpwk\" (UID: \"c30baf0f-3601-4dba-aef3-ab8998759c7e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:19.867994 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:19.867982    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 17:14:19.868043 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:19.868035    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30baf0f-3601-4dba-aef3-ab8998759c7e-cert podName:c30baf0f-3601-4dba-aef3-ab8998759c7e nodeName:}" failed. No retries permitted until 2026-07-09 17:14:20.368021116 +0000 UTC m=+330.075234040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30baf0f-3601-4dba-aef3-ab8998759c7e-cert") pod "odh-model-controller-7998c67dc4-2hpwk" (UID: "c30baf0f-3601-4dba-aef3-ab8998759c7e") : secret "odh-model-controller-webhook-cert" not found
Jul 09 17:14:19.881368 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.881337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qg6g\" (UniqueName: \"kubernetes.io/projected/c30baf0f-3601-4dba-aef3-ab8998759c7e-kube-api-access-7qg6g\") pod \"odh-model-controller-7998c67dc4-2hpwk\" (UID: \"c30baf0f-3601-4dba-aef3-ab8998759c7e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:19.999455 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:19.999423    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:20.069795 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.069758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tls-certs\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:20.072200 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.072178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/491f4d3c-0ea8-4231-a7ef-3233f82282b6-tls-certs\") pod \"kube-auth-proxy-77cb4ccd4b-ndxwf\" (UID: \"491f4d3c-0ea8-4231-a7ef-3233f82282b6\") " pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:20.264264 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.264232    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"
Jul 09 17:14:20.312922 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.312834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:20.372371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.372332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30baf0f-3601-4dba-aef3-ab8998759c7e-cert\") pod \"odh-model-controller-7998c67dc4-2hpwk\" (UID: \"c30baf0f-3601-4dba-aef3-ab8998759c7e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:20.374694 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.374673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30baf0f-3601-4dba-aef3-ab8998759c7e-cert\") pod \"odh-model-controller-7998c67dc4-2hpwk\" (UID: \"c30baf0f-3601-4dba-aef3-ab8998759c7e\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:20.398926 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.398893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf"]
Jul 09 17:14:20.402195 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:14:20.402167    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491f4d3c_0ea8_4231_a7ef_3233f82282b6.slice/crio-fef9c5ceb76cbc08448b82821be20ab9629180a5c4598453f104228db66f24af WatchSource:0}: Error finding container fef9c5ceb76cbc08448b82821be20ab9629180a5c4598453f104228db66f24af: Status 404 returned error can't find the container with id fef9c5ceb76cbc08448b82821be20ab9629180a5c4598453f104228db66f24af
Jul 09 17:14:20.476574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.476538    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:20.517747 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.517663    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzjfk"]
Jul 09 17:14:20.521980 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.521956    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:20.524419 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.524390    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 17:14:20.529010 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.528989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:20.533617 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.533590    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzjfk"]
Jul 09 17:14:20.659901 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.659796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hpwk"]
Jul 09 17:14:20.662858 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:14:20.662804    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30baf0f_3601_4dba_aef3_ab8998759c7e.slice/crio-3b28e7e9ecf50617b488ca39ecc1dc6f42b78508537e3070179577ae8aafa2fd WatchSource:0}: Error finding container 3b28e7e9ecf50617b488ca39ecc1dc6f42b78508537e3070179577ae8aafa2fd: Status 404 returned error can't find the container with id 3b28e7e9ecf50617b488ca39ecc1dc6f42b78508537e3070179577ae8aafa2fd
Jul 09 17:14:20.674715 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.674685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r92kb\" (UniqueName: \"kubernetes.io/projected/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-kube-api-access-r92kb\") pod \"model-serving-api-54d89bd5fc-wzjfk\" (UID: \"1861aee3-8b2c-44ee-9d35-b5587bacbaf9\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:20.674907 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.674749    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzjfk\" (UID: \"1861aee3-8b2c-44ee-9d35-b5587bacbaf9\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:20.716045 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.716009    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"]
Jul 09 17:14:20.719221 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.719192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:20.720324 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.720309    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.722635 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.722610    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 17:14:20.722635 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.722628    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 17:14:20.722797 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.722691    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hw57m\""
Jul 09 17:14:20.722797 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.722718    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 17:14:20.722797 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.722761    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 17:14:20.735424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.735395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"]
Jul 09 17:14:20.775921 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.775799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r92kb\" (UniqueName: \"kubernetes.io/projected/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-kube-api-access-r92kb\") pod \"model-serving-api-54d89bd5fc-wzjfk\" (UID: \"1861aee3-8b2c-44ee-9d35-b5587bacbaf9\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:20.775921 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.775915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzjfk\" (UID: \"1861aee3-8b2c-44ee-9d35-b5587bacbaf9\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:20.776108 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:20.776014    2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 09 17:14:20.776108 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:20.776073    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-tls-certs podName:1861aee3-8b2c-44ee-9d35-b5587bacbaf9 nodeName:}" failed. No retries permitted until 2026-07-09 17:14:21.27605386 +0000 UTC m=+330.983266784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-tls-certs") pod "model-serving-api-54d89bd5fc-wzjfk" (UID: "1861aee3-8b2c-44ee-9d35-b5587bacbaf9") : secret "model-serving-api-tls" not found
Jul 09 17:14:20.782122 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.782089    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:20.784125 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.784093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r92kb\" (UniqueName: \"kubernetes.io/projected/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-kube-api-access-r92kb\") pod \"model-serving-api-54d89bd5fc-wzjfk\" (UID: \"1861aee3-8b2c-44ee-9d35-b5587bacbaf9\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:20.877115 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.877077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-cacerts\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.877115 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.877109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.877533 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.877146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.877533 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.877237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95kzz\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-kube-api-access-95kzz\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.877533 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.877270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.877533 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.877294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-token\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.877533 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.877317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-local-certs\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.977898 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.977855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-local-certs\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.978099 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.977910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-cacerts\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.978099 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.977927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.978099 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.977965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.978099 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.977996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95kzz\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-kube-api-access-95kzz\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.978099 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.978027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.978099 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.978057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-token\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.979081 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.979049    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.980335 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.980307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-local-certs\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.980460 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.980439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-cacerts\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.980797 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.980781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.981051 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.981035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.986195 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.986168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-token\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:20.986711 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:20.986693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95kzz\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-kube-api-access-95kzz\") pod \"istiod-openshift-gateway-7574459656-8tw5k\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:21.017090 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.017053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk" event={"ID":"c30baf0f-3601-4dba-aef3-ab8998759c7e","Type":"ContainerStarted","Data":"3b28e7e9ecf50617b488ca39ecc1dc6f42b78508537e3070179577ae8aafa2fd"}
Jul 09 17:14:21.018170 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.018147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf" event={"ID":"491f4d3c-0ea8-4231-a7ef-3233f82282b6","Type":"ContainerStarted","Data":"fef9c5ceb76cbc08448b82821be20ab9629180a5c4598453f104228db66f24af"}
Jul 09 17:14:21.029487 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.029415    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:21.045932 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.045888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:21.201997 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.200072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"]
Jul 09 17:14:21.206786 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:14:21.206751    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ae5078_6ed8_4a7c_bbdc_d72a8dfc04c8.slice/crio-ad9e13469140a0b56b9941940f2ee01094131a58cfa48a17d20c7017e2fd71d9 WatchSource:0}: Error finding container ad9e13469140a0b56b9941940f2ee01094131a58cfa48a17d20c7017e2fd71d9: Status 404 returned error can't find the container with id ad9e13469140a0b56b9941940f2ee01094131a58cfa48a17d20c7017e2fd71d9
Jul 09 17:14:21.281678 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.281589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzjfk\" (UID: \"1861aee3-8b2c-44ee-9d35-b5587bacbaf9\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:21.284382 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.284313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1861aee3-8b2c-44ee-9d35-b5587bacbaf9-tls-certs\") pod \"model-serving-api-54d89bd5fc-wzjfk\" (UID: \"1861aee3-8b2c-44ee-9d35-b5587bacbaf9\") " pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:21.432279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.432126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:21.615831 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.615773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wzjfk"]
Jul 09 17:14:21.619308 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:14:21.619272    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1861aee3_8b2c_44ee_9d35_b5587bacbaf9.slice/crio-67d427c9d6b208043935d7eb244d3a28a557fd2c0fb72bab31bf82404655d58a WatchSource:0}: Error finding container 67d427c9d6b208043935d7eb244d3a28a557fd2c0fb72bab31bf82404655d58a: Status 404 returned error can't find the container with id 67d427c9d6b208043935d7eb244d3a28a557fd2c0fb72bab31bf82404655d58a
Jul 09 17:14:21.788660 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:21.788573    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:22.024847 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:22.024751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk" event={"ID":"1861aee3-8b2c-44ee-9d35-b5587bacbaf9","Type":"ContainerStarted","Data":"67d427c9d6b208043935d7eb244d3a28a557fd2c0fb72bab31bf82404655d58a"}
Jul 09 17:14:22.026200 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:22.026141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k" event={"ID":"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8","Type":"ContainerStarted","Data":"ad9e13469140a0b56b9941940f2ee01094131a58cfa48a17d20c7017e2fd71d9"}
Jul 09 17:14:26.064146 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:26.064112    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 17:14:26.064523 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:26.064189    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 17:14:26.382779 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:26.382692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:26.495408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:26.495375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:26.654592 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:26.654470    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:26.754173 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:26.754084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:27.048487 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.048438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk" event={"ID":"1861aee3-8b2c-44ee-9d35-b5587bacbaf9","Type":"ContainerStarted","Data":"c977b8e2b48df9c37482706675a79833efa677dc47cecad507a0b8ceb8b20de2"}
Jul 09 17:14:27.048683 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.048506    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:27.050062 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.050038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k" event={"ID":"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8","Type":"ContainerStarted","Data":"e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984"}
Jul 09 17:14:27.050174 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.050162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:27.051684 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.051657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk" event={"ID":"c30baf0f-3601-4dba-aef3-ab8998759c7e","Type":"ContainerStarted","Data":"4e5af89fbe12e528181e645646a344dd6adf1f0370a284d4bf2c8b1a510a446e"}
Jul 09 17:14:27.051838 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.051715    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:27.052355 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.052327    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-8tw5k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 17:14:27.052452 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.052392    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k" podUID="f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 17:14:27.053206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.053188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf" event={"ID":"491f4d3c-0ea8-4231-a7ef-3233f82282b6","Type":"ContainerStarted","Data":"fc59fcca6de9d22040fdf99a35396bb9b61db625a13449b794a7474decef9900"}
Jul 09 17:14:27.065129 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.065081    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk" podStartSLOduration=2.626303462 podStartE2EDuration="7.065061229s" totalImagesPullingTime="4.438757767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:14:27.064088064 +0000 UTC m=+336.771301008" watchObservedRunningTime="2026-07-09 17:14:27.065061229 +0000 UTC m=+336.772274207"
Jul 09 17:14:27.082065 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.082005    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77cb4ccd4b-ndxwf" podStartSLOduration=2.42658484 podStartE2EDuration="8.08198427s" totalImagesPullingTime="5.65539943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:14:27.081473077 +0000 UTC m=+336.788686022" watchObservedRunningTime="2026-07-09 17:14:27.08198427 +0000 UTC m=+336.789197239"
Jul 09 17:14:27.098530 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.098476    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk" podStartSLOduration=2.701905431 podStartE2EDuration="8.098460052s" totalImagesPullingTime="5.396554621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:14:27.097539162 +0000 UTC m=+336.804752138" watchObservedRunningTime="2026-07-09 17:14:27.098460052 +0000 UTC m=+336.805673030"
Jul 09 17:14:27.129730 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.129647    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k" podStartSLOduration=2.274729828 podStartE2EDuration="7.129630046s" totalImagesPullingTime="4.854900218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:14:27.129012561 +0000 UTC m=+336.836225508" watchObservedRunningTime="2026-07-09 17:14:27.129630046 +0000 UTC m=+336.836842992"
Jul 09 17:14:27.415138 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.415053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:27.669908 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.669807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:27.796764 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:27.796734    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:28.057552 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:28.057527    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:30.160091 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.160058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:30.220540 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.220507    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"]
Jul 09 17:14:30.223735 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.223704    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:30.230477 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.230105    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 17:14:30.233081 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.233059    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ws9s8\""
Jul 09 17:14:30.241050 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.241020    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"]
Jul 09 17:14:30.245137 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.245103    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"]
Jul 09 17:14:30.245283 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.245244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:30.247854 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.247829    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 17:14:30.249041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.249020    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vn896\""
Jul 09 17:14:30.260273 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.260240    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"]
Jul 09 17:14:30.262203 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.262170    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:30.361583 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.361528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxrp\" (UniqueName: \"kubernetes.io/projected/f214251f-1295-4b4d-b41b-37a7d077a9a3-kube-api-access-mfxrp\") pod \"kserve-controller-manager-d6f4b65b8-65bdr\" (UID: \"f214251f-1295-4b4d-b41b-37a7d077a9a3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:30.361583 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.361586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f214251f-1295-4b4d-b41b-37a7d077a9a3-cert\") pod \"kserve-controller-manager-d6f4b65b8-65bdr\" (UID: \"f214251f-1295-4b4d-b41b-37a7d077a9a3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:30.361852 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.361641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt2hl\" (UniqueName: \"kubernetes.io/projected/14026ecb-4f12-4454-82b6-ed45de9a6626-kube-api-access-rt2hl\") pod \"llmisvc-controller-manager-777c6bd7d5-4z4hm\" (UID: \"14026ecb-4f12-4454-82b6-ed45de9a6626\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:30.361852 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.361736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14026ecb-4f12-4454-82b6-ed45de9a6626-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4z4hm\" (UID: \"14026ecb-4f12-4454-82b6-ed45de9a6626\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:30.381663 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.381627    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:30.462956 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.462777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14026ecb-4f12-4454-82b6-ed45de9a6626-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4z4hm\" (UID: \"14026ecb-4f12-4454-82b6-ed45de9a6626\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:30.462956 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.462904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxrp\" (UniqueName: \"kubernetes.io/projected/f214251f-1295-4b4d-b41b-37a7d077a9a3-kube-api-access-mfxrp\") pod \"kserve-controller-manager-d6f4b65b8-65bdr\" (UID: \"f214251f-1295-4b4d-b41b-37a7d077a9a3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:30.462956 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:30.462931    2579 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 09 17:14:30.462956 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.462943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f214251f-1295-4b4d-b41b-37a7d077a9a3-cert\") pod \"kserve-controller-manager-d6f4b65b8-65bdr\" (UID: \"f214251f-1295-4b4d-b41b-37a7d077a9a3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:30.463265 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.462985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt2hl\" (UniqueName: \"kubernetes.io/projected/14026ecb-4f12-4454-82b6-ed45de9a6626-kube-api-access-rt2hl\") pod \"llmisvc-controller-manager-777c6bd7d5-4z4hm\" (UID: \"14026ecb-4f12-4454-82b6-ed45de9a6626\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:30.463265 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:30.463057    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14026ecb-4f12-4454-82b6-ed45de9a6626-cert podName:14026ecb-4f12-4454-82b6-ed45de9a6626 nodeName:}" failed. No retries permitted until 2026-07-09 17:14:30.963034385 +0000 UTC m=+340.670247564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14026ecb-4f12-4454-82b6-ed45de9a6626-cert") pod "llmisvc-controller-manager-777c6bd7d5-4z4hm" (UID: "14026ecb-4f12-4454-82b6-ed45de9a6626") : secret "llmisvc-webhook-server-cert" not found
Jul 09 17:14:30.465449 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.465424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f214251f-1295-4b4d-b41b-37a7d077a9a3-cert\") pod \"kserve-controller-manager-d6f4b65b8-65bdr\" (UID: \"f214251f-1295-4b4d-b41b-37a7d077a9a3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:30.477261 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.477230    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxrp\" (UniqueName: \"kubernetes.io/projected/f214251f-1295-4b4d-b41b-37a7d077a9a3-kube-api-access-mfxrp\") pod \"kserve-controller-manager-d6f4b65b8-65bdr\" (UID: \"f214251f-1295-4b4d-b41b-37a7d077a9a3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:30.477366 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.477289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt2hl\" (UniqueName: \"kubernetes.io/projected/14026ecb-4f12-4454-82b6-ed45de9a6626-kube-api-access-rt2hl\") pod \"llmisvc-controller-manager-777c6bd7d5-4z4hm\" (UID: \"14026ecb-4f12-4454-82b6-ed45de9a6626\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:30.533685 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.533646    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:30.662603 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.662577    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"]
Jul 09 17:14:30.664891 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:14:30.664862    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf214251f_1295_4b4d_b41b_37a7d077a9a3.slice/crio-81e2ebb0d5b63762014a1463c8a057b6f31d5daf273c023281ffcbf7b0c7cd05 WatchSource:0}: Error finding container 81e2ebb0d5b63762014a1463c8a057b6f31d5daf273c023281ffcbf7b0c7cd05: Status 404 returned error can't find the container with id 81e2ebb0d5b63762014a1463c8a057b6f31d5daf273c023281ffcbf7b0c7cd05
Jul 09 17:14:30.693993 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.693960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:30.966910 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.966860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14026ecb-4f12-4454-82b6-ed45de9a6626-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4z4hm\" (UID: \"14026ecb-4f12-4454-82b6-ed45de9a6626\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:30.969384 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:30.969360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14026ecb-4f12-4454-82b6-ed45de9a6626-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4z4hm\" (UID: \"14026ecb-4f12-4454-82b6-ed45de9a6626\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:31.069665 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:31.069630    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr" event={"ID":"f214251f-1295-4b4d-b41b-37a7d077a9a3","Type":"ContainerStarted","Data":"81e2ebb0d5b63762014a1463c8a057b6f31d5daf273c023281ffcbf7b0c7cd05"}
Jul 09 17:14:31.156293 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:31.156258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:31.295914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:31.295891    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"]
Jul 09 17:14:31.297998 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:14:31.297970    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod14026ecb_4f12_4454_82b6_ed45de9a6626.slice/crio-dd33dd3c90490c09cf86ff4c1e349b3c0af9134065106dc886febc0ab5aefe5a WatchSource:0}: Error finding container dd33dd3c90490c09cf86ff4c1e349b3c0af9134065106dc886febc0ab5aefe5a: Status 404 returned error can't find the container with id dd33dd3c90490c09cf86ff4c1e349b3c0af9134065106dc886febc0ab5aefe5a
Jul 09 17:14:31.460699 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:31.460662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:31.621411 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:31.621374    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:31.702018 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:31.701986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:32.077330 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.077297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm" event={"ID":"14026ecb-4f12-4454-82b6-ed45de9a6626","Type":"ContainerStarted","Data":"dd33dd3c90490c09cf86ff4c1e349b3c0af9134065106dc886febc0ab5aefe5a"}
Jul 09 17:14:32.600448 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.600402    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"]
Jul 09 17:14:32.600911 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.600670    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k" podUID="f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" containerName="discovery" containerID="cri-o://e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984" gracePeriod=30
Jul 09 17:14:32.847785 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.847752    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:32.983994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.983905    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-kubeconfig\") pod \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") "
Jul 09 17:14:32.983994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.983974    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95kzz\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-kube-api-access-95kzz\") pod \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") "
Jul 09 17:14:32.984240 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.984013    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-cacerts\") pod \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") "
Jul 09 17:14:32.984240 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.984059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-token\") pod \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") "
Jul 09 17:14:32.984240 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.984083    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-local-certs\") pod \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") "
Jul 09 17:14:32.984240 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.984101    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-ca-configmap\") pod \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") "
Jul 09 17:14:32.984240 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.984141    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-dns-cert\") pod \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\" (UID: \"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8\") "
Jul 09 17:14:32.984908 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.984628    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" (UID: "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:14:32.987001 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.986973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" (UID: "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:14:32.987151 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.987129    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-kube-api-access-95kzz" (OuterVolumeSpecName: "kube-api-access-95kzz") pod "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" (UID: "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8"). InnerVolumeSpecName "kube-api-access-95kzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:14:32.987226 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.987192    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-cacerts" (OuterVolumeSpecName: "cacerts") pod "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" (UID: "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:14:32.987291 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.987237    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" (UID: "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:14:32.987352 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.987334    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" (UID: "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:14:32.987352 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:32.987339    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-local-certs" (OuterVolumeSpecName: "local-certs") pod "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" (UID: "f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:14:33.084787 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084721    2579 generic.go:356] "Generic (PLEG): container finished" podID="f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" containerID="e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984" exitCode=0
Jul 09 17:14:33.084787 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k" event={"ID":"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8","Type":"ContainerDied","Data":"e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984"}
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084780    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k" event={"ID":"f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8","Type":"ContainerDied","Data":"ad9e13469140a0b56b9941940f2ee01094131a58cfa48a17d20c7017e2fd71d9"}
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084858    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95kzz\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-kube-api-access-95kzz\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084878    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-cacerts\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084891    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-token\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084904    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-local-certs\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084917    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-ca-configmap\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084864    2579 scope.go:117] "RemoveContainer" containerID="e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984"
Jul 09 17:14:33.085057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.084931    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-csr-dns-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:14:33.085470 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.085072    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8-istio-kubeconfig\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:14:33.109972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.109913    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"]
Jul 09 17:14:33.114552 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.114520    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8tw5k"]
Jul 09 17:14:33.624346 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.624321    2579 scope.go:117] "RemoveContainer" containerID="e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984"
Jul 09 17:14:33.624801 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:14:33.624767    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984\": container with ID starting with e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984 not found: ID does not exist" containerID="e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984"
Jul 09 17:14:33.624905 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:33.624836    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984"} err="failed to get container status \"e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984\": rpc error: code = NotFound desc = could not find container \"e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984\": container with ID starting with e51c7b18ae718ae2806f8475c1205847dce38b0f975a027a14594ed24b803984 not found: ID does not exist"
Jul 09 17:14:34.091379 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:34.091346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr" event={"ID":"f214251f-1295-4b4d-b41b-37a7d077a9a3","Type":"ContainerStarted","Data":"80bb32a3fee965efae656002f78fa17f28a52c8be333599c72a8ddec8d151b05"}
Jul 09 17:14:34.091558 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:34.091467    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:14:34.106766 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:34.106714    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr" podStartSLOduration=1.100833414 podStartE2EDuration="4.106698097s" totalImagesPullingTime="3.005864683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:14:34.105352778 +0000 UTC m=+343.812565737" watchObservedRunningTime="2026-07-09 17:14:34.106698097 +0000 UTC m=+343.813911039"
Jul 09 17:14:34.815994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:34.815962    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" path="/var/lib/kubelet/pods/f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8/volumes"
Jul 09 17:14:35.096921 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:35.096796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm" event={"ID":"14026ecb-4f12-4454-82b6-ed45de9a6626","Type":"ContainerStarted","Data":"427cec80c7b13edb4950ad1f21aa2c78716282718de01efb4a3bc6e3c7a439a4"}
Jul 09 17:14:35.097100 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:35.097035    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:14:35.112547 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:35.112491    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm" podStartSLOduration=1.493138365 podStartE2EDuration="5.112471351s" totalImagesPullingTime="3.619332986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:14:35.112447482 +0000 UTC m=+344.819660483" watchObservedRunningTime="2026-07-09 17:14:35.112471351 +0000 UTC m=+344.819684298"
Jul 09 17:14:38.059058 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:38.059028    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2hpwk"
Jul 09 17:14:38.061939 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:38.061916    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wzjfk"
Jul 09 17:14:41.500422 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:41.500339    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:41.601270 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:41.601239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:43.447129 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:43.447100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:14:43.501615 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:14:43.501586    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:05.101827 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:05.101786    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65bdr"
Jul 09 17:15:06.103292 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:06.103258    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4z4hm"
Jul 09 17:15:20.375483 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.375440    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:20.472087 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.472053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:20.494586 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.494547    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vwwb"]
Jul 09 17:15:20.494956 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.494938    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" containerName="discovery"
Jul 09 17:15:20.495049 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.494959    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" containerName="discovery"
Jul 09 17:15:20.495049 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.495036    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ae5078-6ed8-4a7c-bbdc-d72a8dfc04c8" containerName="discovery"
Jul 09 17:15:20.497215 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.497185    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb"
Jul 09 17:15:20.499739 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.499713    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 17:15:20.499889 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.499752    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 17:15:20.500028 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.500015    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-crwdd\""
Jul 09 17:15:20.507122 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.507076    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vwwb"]
Jul 09 17:15:20.540748 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.540718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:20.646851 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.646722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9cpf\" (UniqueName: \"kubernetes.io/projected/0bffd83a-1aee-4172-a0ed-f9e86228ad18-kube-api-access-r9cpf\") pod \"kuadrant-operator-catalog-7vwwb\" (UID: \"0bffd83a-1aee-4172-a0ed-f9e86228ad18\") " pod="kuadrant-system/kuadrant-operator-catalog-7vwwb"
Jul 09 17:15:20.747193 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.747155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cpf\" (UniqueName: \"kubernetes.io/projected/0bffd83a-1aee-4172-a0ed-f9e86228ad18-kube-api-access-r9cpf\") pod \"kuadrant-operator-catalog-7vwwb\" (UID: \"0bffd83a-1aee-4172-a0ed-f9e86228ad18\") " pod="kuadrant-system/kuadrant-operator-catalog-7vwwb"
Jul 09 17:15:20.756671 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.756627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9cpf\" (UniqueName: \"kubernetes.io/projected/0bffd83a-1aee-4172-a0ed-f9e86228ad18-kube-api-access-r9cpf\") pod \"kuadrant-operator-catalog-7vwwb\" (UID: \"0bffd83a-1aee-4172-a0ed-f9e86228ad18\") " pod="kuadrant-system/kuadrant-operator-catalog-7vwwb"
Jul 09 17:15:20.808290 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.808259    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb"
Jul 09 17:15:20.872866 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.872831    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vwwb"]
Jul 09 17:15:20.952030 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:20.951986    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vwwb"]
Jul 09 17:15:20.955602 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:15:20.955571    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bffd83a_1aee_4172_a0ed_f9e86228ad18.slice/crio-b0762a7e42d2027a18b17300a0b903c4398e9a21b76b1968d9d9856f14d3f742 WatchSource:0}: Error finding container b0762a7e42d2027a18b17300a0b903c4398e9a21b76b1968d9d9856f14d3f742: Status 404 returned error can't find the container with id b0762a7e42d2027a18b17300a0b903c4398e9a21b76b1968d9d9856f14d3f742
Jul 09 17:15:21.079148 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.079113    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-blrdj"]
Jul 09 17:15:21.082423 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.082405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:21.090362 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.090325    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-blrdj"]
Jul 09 17:15:21.151122 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.151080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klskt\" (UniqueName: \"kubernetes.io/projected/6dfc26aa-5607-4e3d-9b3e-969103d2b40a-kube-api-access-klskt\") pod \"kuadrant-operator-catalog-blrdj\" (UID: \"6dfc26aa-5607-4e3d-9b3e-969103d2b40a\") " pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:21.251534 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.251505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klskt\" (UniqueName: \"kubernetes.io/projected/6dfc26aa-5607-4e3d-9b3e-969103d2b40a-kube-api-access-klskt\") pod \"kuadrant-operator-catalog-blrdj\" (UID: \"6dfc26aa-5607-4e3d-9b3e-969103d2b40a\") " pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:21.259509 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.259476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klskt\" (UniqueName: \"kubernetes.io/projected/6dfc26aa-5607-4e3d-9b3e-969103d2b40a-kube-api-access-klskt\") pod \"kuadrant-operator-catalog-blrdj\" (UID: \"6dfc26aa-5607-4e3d-9b3e-969103d2b40a\") " pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:21.272628 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.272591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb" event={"ID":"0bffd83a-1aee-4172-a0ed-f9e86228ad18","Type":"ContainerStarted","Data":"b0762a7e42d2027a18b17300a0b903c4398e9a21b76b1968d9d9856f14d3f742"}
Jul 09 17:15:21.392055 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.392020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:21.523331 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:21.523254    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-blrdj"]
Jul 09 17:15:21.526378 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:15:21.526352    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfc26aa_5607_4e3d_9b3e_969103d2b40a.slice/crio-f981acfc3d605d61976c2c39ff8b8d52e7ca2b144c2a9ff848ddf715f8747e03 WatchSource:0}: Error finding container f981acfc3d605d61976c2c39ff8b8d52e7ca2b144c2a9ff848ddf715f8747e03: Status 404 returned error can't find the container with id f981acfc3d605d61976c2c39ff8b8d52e7ca2b144c2a9ff848ddf715f8747e03
Jul 09 17:15:22.278519 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:22.278486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-blrdj" event={"ID":"6dfc26aa-5607-4e3d-9b3e-969103d2b40a","Type":"ContainerStarted","Data":"f981acfc3d605d61976c2c39ff8b8d52e7ca2b144c2a9ff848ddf715f8747e03"}
Jul 09 17:15:24.291142 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.291100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb" event={"ID":"0bffd83a-1aee-4172-a0ed-f9e86228ad18","Type":"ContainerStarted","Data":"8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050"}
Jul 09 17:15:24.291633 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.291168    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb" podUID="0bffd83a-1aee-4172-a0ed-f9e86228ad18" containerName="registry-server" containerID="cri-o://8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050" gracePeriod=2
Jul 09 17:15:24.292589 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.292555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-blrdj" event={"ID":"6dfc26aa-5607-4e3d-9b3e-969103d2b40a","Type":"ContainerStarted","Data":"f1d932fd16344c1283403c28a5b417796f60716f25334813ff81756f99fccfa1"}
Jul 09 17:15:24.306619 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.306570    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb" podStartSLOduration=1.7349160700000001 podStartE2EDuration="4.30655375s" totalImagesPullingTime="2.57163768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:24.305785551 +0000 UTC m=+394.012998499" watchObservedRunningTime="2026-07-09 17:15:24.30655375 +0000 UTC m=+394.013766695"
Jul 09 17:15:24.320341 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.320289    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-blrdj" podStartSLOduration=1.31492924 podStartE2EDuration="3.320269208s" totalImagesPullingTime="2.005339968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:24.3192421 +0000 UTC m=+394.026455082" watchObservedRunningTime="2026-07-09 17:15:24.320269208 +0000 UTC m=+394.027482153"
Jul 09 17:15:24.535644 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.535618    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb"
Jul 09 17:15:24.681745 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.681645    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9cpf\" (UniqueName: \"kubernetes.io/projected/0bffd83a-1aee-4172-a0ed-f9e86228ad18-kube-api-access-r9cpf\") pod \"0bffd83a-1aee-4172-a0ed-f9e86228ad18\" (UID: \"0bffd83a-1aee-4172-a0ed-f9e86228ad18\") "
Jul 09 17:15:24.683883 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.683843    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bffd83a-1aee-4172-a0ed-f9e86228ad18-kube-api-access-r9cpf" (OuterVolumeSpecName: "kube-api-access-r9cpf") pod "0bffd83a-1aee-4172-a0ed-f9e86228ad18" (UID: "0bffd83a-1aee-4172-a0ed-f9e86228ad18"). InnerVolumeSpecName "kube-api-access-r9cpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:15:24.782400 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:24.782352    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9cpf\" (UniqueName: \"kubernetes.io/projected/0bffd83a-1aee-4172-a0ed-f9e86228ad18-kube-api-access-r9cpf\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:15:25.298028 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.297991    2579 generic.go:356] "Generic (PLEG): container finished" podID="0bffd83a-1aee-4172-a0ed-f9e86228ad18" containerID="8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050" exitCode=0
Jul 09 17:15:25.298444 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.298034    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb"
Jul 09 17:15:25.298444 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.298078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb" event={"ID":"0bffd83a-1aee-4172-a0ed-f9e86228ad18","Type":"ContainerDied","Data":"8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050"}
Jul 09 17:15:25.298444 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.298129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vwwb" event={"ID":"0bffd83a-1aee-4172-a0ed-f9e86228ad18","Type":"ContainerDied","Data":"b0762a7e42d2027a18b17300a0b903c4398e9a21b76b1968d9d9856f14d3f742"}
Jul 09 17:15:25.298444 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.298150    2579 scope.go:117] "RemoveContainer" containerID="8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050"
Jul 09 17:15:25.306476 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.306455    2579 scope.go:117] "RemoveContainer" containerID="8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050"
Jul 09 17:15:25.306734 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:15:25.306712    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050\": container with ID starting with 8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050 not found: ID does not exist" containerID="8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050"
Jul 09 17:15:25.306787 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.306744    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050"} err="failed to get container status \"8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050\": rpc error: code = NotFound desc = could not find container \"8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050\": container with ID starting with 8ee41ec990bcec39512ab5ff0d519d21e6e8af1443c47768c3900378000af050 not found: ID does not exist"
Jul 09 17:15:25.312643 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.312617    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vwwb"]
Jul 09 17:15:25.316247 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:25.316222    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vwwb"]
Jul 09 17:15:26.814424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:26.814396    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bffd83a-1aee-4172-a0ed-f9e86228ad18" path="/var/lib/kubelet/pods/0bffd83a-1aee-4172-a0ed-f9e86228ad18/volumes"
Jul 09 17:15:31.392879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:31.392840    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:31.393392 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:31.392903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:31.415254 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:31.415227    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:32.350254 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:32.350216    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-blrdj"
Jul 09 17:15:49.011178 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:49.011142    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:49.630429 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:49.630399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:49.732307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:49.732278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:49.947917 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:49.947805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:50.048494 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:50.048467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:53.089080 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.089049    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"]
Jul 09 17:15:53.089549 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.089314    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bffd83a-1aee-4172-a0ed-f9e86228ad18" containerName="registry-server"
Jul 09 17:15:53.089549 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.089324    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bffd83a-1aee-4172-a0ed-f9e86228ad18" containerName="registry-server"
Jul 09 17:15:53.089549 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.089382    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bffd83a-1aee-4172-a0ed-f9e86228ad18" containerName="registry-server"
Jul 09 17:15:53.093740 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.093719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"
Jul 09 17:15:53.096168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.096137    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5v2zl\""
Jul 09 17:15:53.097604 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.097584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4b8d\" (UniqueName: \"kubernetes.io/projected/b5cdd00d-2e86-4f63-95a2-7d02ee31cf82-kube-api-access-d4b8d\") pod \"authorino-operator-75cc8d5cb7-wzb48\" (UID: \"b5cdd00d-2e86-4f63-95a2-7d02ee31cf82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"
Jul 09 17:15:53.100685 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.100662    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"]
Jul 09 17:15:53.198997 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.198954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4b8d\" (UniqueName: \"kubernetes.io/projected/b5cdd00d-2e86-4f63-95a2-7d02ee31cf82-kube-api-access-d4b8d\") pod \"authorino-operator-75cc8d5cb7-wzb48\" (UID: \"b5cdd00d-2e86-4f63-95a2-7d02ee31cf82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"
Jul 09 17:15:53.206944 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.206914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4b8d\" (UniqueName: \"kubernetes.io/projected/b5cdd00d-2e86-4f63-95a2-7d02ee31cf82-kube-api-access-d4b8d\") pod \"authorino-operator-75cc8d5cb7-wzb48\" (UID: \"b5cdd00d-2e86-4f63-95a2-7d02ee31cf82\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"
Jul 09 17:15:53.404448 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.404336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"
Jul 09 17:15:53.544691 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:53.544666    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"]
Jul 09 17:15:53.547222 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:15:53.547195    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cdd00d_2e86_4f63_95a2_7d02ee31cf82.slice/crio-3472b114dc2f9c0738c7064620d12c9601fc094dac7d825dc539a13ab394cd34 WatchSource:0}: Error finding container 3472b114dc2f9c0738c7064620d12c9601fc094dac7d825dc539a13ab394cd34: Status 404 returned error can't find the container with id 3472b114dc2f9c0738c7064620d12c9601fc094dac7d825dc539a13ab394cd34
Jul 09 17:15:54.416805 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:54.416213    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48" event={"ID":"b5cdd00d-2e86-4f63-95a2-7d02ee31cf82","Type":"ContainerStarted","Data":"3472b114dc2f9c0738c7064620d12c9601fc094dac7d825dc539a13ab394cd34"}
Jul 09 17:15:54.459537 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:54.459495    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:56.348034 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.347997    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"]
Jul 09 17:15:56.350270 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.350248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:15:56.354341 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.354322    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-52ljp\""
Jul 09 17:15:56.360670 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.360643    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"]
Jul 09 17:15:56.425631 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.425592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48" event={"ID":"b5cdd00d-2e86-4f63-95a2-7d02ee31cf82","Type":"ContainerStarted","Data":"935e8c0a9dc0875f27b30689e7f070afbf0da3e3dfd06ca0c6f822de77549b73"}
Jul 09 17:15:56.425831 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.425744    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"
Jul 09 17:15:56.430202 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.430178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7jq\" (UniqueName: \"kubernetes.io/projected/37f5c8b9-1c91-4a80-869c-e583eacdbae4-kube-api-access-xr7jq\") pod \"limitador-operator-controller-manager-859d7b78bd-pkpvp\" (UID: \"37f5c8b9-1c91-4a80-869c-e583eacdbae4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:15:56.456797 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.456739    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48" podStartSLOduration=1.146982627 podStartE2EDuration="3.456720404s" totalImagesPullingTime="2.309737777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:56.454222459 +0000 UTC m=+426.161435416" watchObservedRunningTime="2026-07-09 17:15:56.456720404 +0000 UTC m=+426.163933350"
Jul 09 17:15:56.478767 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.478735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:56.530978 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.530936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7jq\" (UniqueName: \"kubernetes.io/projected/37f5c8b9-1c91-4a80-869c-e583eacdbae4-kube-api-access-xr7jq\") pod \"limitador-operator-controller-manager-859d7b78bd-pkpvp\" (UID: \"37f5c8b9-1c91-4a80-869c-e583eacdbae4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:15:56.546640 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.546604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7jq\" (UniqueName: \"kubernetes.io/projected/37f5c8b9-1c91-4a80-869c-e583eacdbae4-kube-api-access-xr7jq\") pod \"limitador-operator-controller-manager-859d7b78bd-pkpvp\" (UID: \"37f5c8b9-1c91-4a80-869c-e583eacdbae4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:15:56.661191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.661100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:15:56.815470 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:56.815444    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"]
Jul 09 17:15:56.817345 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:15:56.817315    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f5c8b9_1c91_4a80_869c_e583eacdbae4.slice/crio-87627f2f0cf76e4b15ba4d5d89fc271b0d9c2c67828a355cbfb586cdf2eccf57 WatchSource:0}: Error finding container 87627f2f0cf76e4b15ba4d5d89fc271b0d9c2c67828a355cbfb586cdf2eccf57: Status 404 returned error can't find the container with id 87627f2f0cf76e4b15ba4d5d89fc271b0d9c2c67828a355cbfb586cdf2eccf57
Jul 09 17:15:57.432249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:57.432217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:57.434316 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:57.434286    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp" event={"ID":"37f5c8b9-1c91-4a80-869c-e583eacdbae4","Type":"ContainerStarted","Data":"87627f2f0cf76e4b15ba4d5d89fc271b0d9c2c67828a355cbfb586cdf2eccf57"}
Jul 09 17:15:58.244369 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:58.244342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:15:59.444599 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.444560    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp" event={"ID":"37f5c8b9-1c91-4a80-869c-e583eacdbae4","Type":"ContainerStarted","Data":"f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db"}
Jul 09 17:15:59.445036 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.444708    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:15:59.467478 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.467426    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp" podStartSLOduration=1.551355822 podStartE2EDuration="3.467407142s" totalImagesPullingTime="1.91605132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:59.467100702 +0000 UTC m=+429.174313649" watchObservedRunningTime="2026-07-09 17:15:59.467407142 +0000 UTC m=+429.174620088"
Jul 09 17:15:59.669408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.669370    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"]
Jul 09 17:15:59.676706 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.676677    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"
Jul 09 17:15:59.679844 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.679823    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dj5ts\""
Jul 09 17:15:59.679971 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.679845    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 17:15:59.687752 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.687725    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"]
Jul 09 17:15:59.759383 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.759347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fdz\" (UniqueName: \"kubernetes.io/projected/81d9d454-dcf4-4179-b44b-876dd3b7546f-kube-api-access-j9fdz\") pod \"dns-operator-controller-manager-864dd78c4c-ljwwq\" (UID: \"81d9d454-dcf4-4179-b44b-876dd3b7546f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"
Jul 09 17:15:59.860226 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.860189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fdz\" (UniqueName: \"kubernetes.io/projected/81d9d454-dcf4-4179-b44b-876dd3b7546f-kube-api-access-j9fdz\") pod \"dns-operator-controller-manager-864dd78c4c-ljwwq\" (UID: \"81d9d454-dcf4-4179-b44b-876dd3b7546f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"
Jul 09 17:15:59.869895 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.869863    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fdz\" (UniqueName: \"kubernetes.io/projected/81d9d454-dcf4-4179-b44b-876dd3b7546f-kube-api-access-j9fdz\") pod \"dns-operator-controller-manager-864dd78c4c-ljwwq\" (UID: \"81d9d454-dcf4-4179-b44b-876dd3b7546f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"
Jul 09 17:15:59.987606 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:15:59.987565    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"
Jul 09 17:16:00.127769 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:00.127746    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"]
Jul 09 17:16:00.130515 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:16:00.130322    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d9d454_dcf4_4179_b44b_876dd3b7546f.slice/crio-fb02c1f545789818887761b382b4c37f2fadd3fa2f194062cf58c4f1d06f1ebb WatchSource:0}: Error finding container fb02c1f545789818887761b382b4c37f2fadd3fa2f194062cf58c4f1d06f1ebb: Status 404 returned error can't find the container with id fb02c1f545789818887761b382b4c37f2fadd3fa2f194062cf58c4f1d06f1ebb
Jul 09 17:16:00.288202 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:00.288163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:00.392048 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:00.391968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:00.450268 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:00.450233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq" event={"ID":"81d9d454-dcf4-4179-b44b-876dd3b7546f","Type":"ContainerStarted","Data":"fb02c1f545789818887761b382b4c37f2fadd3fa2f194062cf58c4f1d06f1ebb"}
Jul 09 17:16:00.487759 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:00.487727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:00.955327 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:00.955293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:02.461601 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:02.461513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq" event={"ID":"81d9d454-dcf4-4179-b44b-876dd3b7546f","Type":"ContainerStarted","Data":"10d1840e1a9192ad4489c2f95fee1cd8703181bdc9912987644833c6a22c7460"}
Jul 09 17:16:02.462004 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:02.461625    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"
Jul 09 17:16:02.478281 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:02.478228    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq" podStartSLOduration=1.5036626979999999 podStartE2EDuration="3.478207311s" totalImagesPullingTime="1.974544613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:02.476899996 +0000 UTC m=+432.184112941" watchObservedRunningTime="2026-07-09 17:16:02.478207311 +0000 UTC m=+432.185420257"
Jul 09 17:16:04.077453 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.077415    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:04.587345 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.587304    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"]
Jul 09 17:16:04.590133 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.590116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:04.592578 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.592559    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-srbrf\""
Jul 09 17:16:04.605402 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.605369    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"]
Jul 09 17:16:04.700268 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.700216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" (UID: \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:04.700465 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.700292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftz9m\" (UniqueName: \"kubernetes.io/projected/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-kube-api-access-ftz9m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" (UID: \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:04.801575 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.801522    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftz9m\" (UniqueName: \"kubernetes.io/projected/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-kube-api-access-ftz9m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" (UID: \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:04.801777 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.801609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" (UID: \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:04.802035 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.802015    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" (UID: \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:04.811257 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.811217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftz9m\" (UniqueName: \"kubernetes.io/projected/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-kube-api-access-ftz9m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" (UID: \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:04.900146 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:04.900048    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:05.042136 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:05.042028    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"]
Jul 09 17:16:05.044712 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:16:05.044680    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7c4fca_89ac_4a2b_9958_6523b7d7fed1.slice/crio-6978aa76bec4fe4ac6f385bafa9c79373582213ae4aed7c459be46c97139730e WatchSource:0}: Error finding container 6978aa76bec4fe4ac6f385bafa9c79373582213ae4aed7c459be46c97139730e: Status 404 returned error can't find the container with id 6978aa76bec4fe4ac6f385bafa9c79373582213ae4aed7c459be46c97139730e
Jul 09 17:16:05.477608 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:05.477573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw" event={"ID":"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1","Type":"ContainerStarted","Data":"6978aa76bec4fe4ac6f385bafa9c79373582213ae4aed7c459be46c97139730e"}
Jul 09 17:16:06.380070 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:06.379988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:06.481330 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:06.481297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:07.437238 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:07.437207    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzb48"
Jul 09 17:16:09.818218 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:09.818186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:09.919461 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:09.919402    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:10.453164 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:10.453131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:16:11.507381 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:11.507344    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw" event={"ID":"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1","Type":"ContainerStarted","Data":"e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57"}
Jul 09 17:16:11.507785 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:11.507473    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:11.530902 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:11.530847    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw" podStartSLOduration=1.425116843 podStartE2EDuration="7.530803541s" totalImagesPullingTime="6.105686698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:11.528996169 +0000 UTC m=+441.236209117" watchObservedRunningTime="2026-07-09 17:16:11.530803541 +0000 UTC m=+441.238016488"
Jul 09 17:16:13.234031 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:13.233998    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:13.332157 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:13.332123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:13.468720 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:13.468684    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwwq"
Jul 09 17:16:14.057181 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:14.057146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:14.249619 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:14.249576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:15.130137 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:15.130105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:17.254958 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:17.254925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:17.365024 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:17.364988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:22.514402 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:22.514372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:23.543472 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.543430    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"]
Jul 09 17:16:23.546803 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.546777    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:23.560571 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.560540    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"]
Jul 09 17:16:23.660741 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.660703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d47fb529-9350-44c8-b21c-e1ce51b5db9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" (UID: \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:23.660945 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.660769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pv9l\" (UniqueName: \"kubernetes.io/projected/d47fb529-9350-44c8-b21c-e1ce51b5db9f-kube-api-access-4pv9l\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" (UID: \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:23.761652 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.761611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d47fb529-9350-44c8-b21c-e1ce51b5db9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" (UID: \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:23.761855 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.761672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pv9l\" (UniqueName: \"kubernetes.io/projected/d47fb529-9350-44c8-b21c-e1ce51b5db9f-kube-api-access-4pv9l\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" (UID: \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:23.762107 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.762087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d47fb529-9350-44c8-b21c-e1ce51b5db9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" (UID: \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:23.774160 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.774133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pv9l\" (UniqueName: \"kubernetes.io/projected/d47fb529-9350-44c8-b21c-e1ce51b5db9f-kube-api-access-4pv9l\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" (UID: \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:23.856516 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.856419    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:23.996038 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:23.996003    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"]
Jul 09 17:16:24.000924 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:16:24.000871    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47fb529_9350_44c8_b21c_e1ce51b5db9f.slice/crio-05b3d5879947043c25e337988db3eb46fb4334254342e3b74332722155bb8e4a WatchSource:0}: Error finding container 05b3d5879947043c25e337988db3eb46fb4334254342e3b74332722155bb8e4a: Status 404 returned error can't find the container with id 05b3d5879947043c25e337988db3eb46fb4334254342e3b74332722155bb8e4a
Jul 09 17:16:24.279361 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.279327    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"]
Jul 09 17:16:24.285780 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.285757    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"]
Jul 09 17:16:24.297584 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.297544    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"]
Jul 09 17:16:24.297804 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.297758    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" containerName="manager" containerID="cri-o://e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57" gracePeriod=2
Jul 09 17:16:24.303574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.303548    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"]
Jul 09 17:16:24.304681 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.304403    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" containerName="manager"
Jul 09 17:16:24.304681 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.304686    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" containerName="manager"
Jul 09 17:16:24.304905 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.304791    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" containerName="manager"
Jul 09 17:16:24.308305 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.308254    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"]
Jul 09 17:16:24.308435 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.308374    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:24.319972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.319927    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"]
Jul 09 17:16:24.320505 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.320463    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\": pods \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.320768 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.320751    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" containerName="manager"
Jul 09 17:16:24.320880 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.320869    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" containerName="manager"
Jul 09 17:16:24.323033 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.321046    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" containerName="manager"
Jul 09 17:16:24.326587 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.326553    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"]
Jul 09 17:16:24.326688 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.326598    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"]
Jul 09 17:16:24.326735 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.326683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:24.326831 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.326787    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" containerName="manager" containerID="cri-o://f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db" gracePeriod=2
Jul 09 17:16:24.335108 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.335018    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"]
Jul 09 17:16:24.337522 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.337310    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"]
Jul 09 17:16:24.342607 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.342571    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.345104 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.345063    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.352642 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.352616    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"]
Jul 09 17:16:24.353106 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.353089    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" containerName="manager"
Jul 09 17:16:24.353164 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.353111    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" containerName="manager"
Jul 09 17:16:24.353202 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.353194    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" containerName="manager"
Jul 09 17:16:24.358166 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.358142    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"
Jul 09 17:16:24.367181 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.367145    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"]
Jul 09 17:16:24.370468 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.370425    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkpvp\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:16:24.387873 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.387804    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkpvp\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:16:24.389640 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.389611    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.468147 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.468038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9kd2\" (UniqueName: \"kubernetes.io/projected/c6ae0d9e-0180-4a60-96b8-0db791e145f2-kube-api-access-n9kd2\") pod \"limitador-operator-controller-manager-859d7b78bd-lfbr2\" (UID: \"c6ae0d9e-0180-4a60-96b8-0db791e145f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"
Jul 09 17:16:24.468147 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.468097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqnc4\" (UniqueName: \"kubernetes.io/projected/02a6f610-6518-4a5d-bbc6-a88d646faabe-kube-api-access-wqnc4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpk2k\" (UID: \"02a6f610-6518-4a5d-bbc6-a88d646faabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:24.468360 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.468248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72xd4\" (UniqueName: \"kubernetes.io/projected/dcec7653-0ad4-4599-9874-715c535aad5e-kube-api-access-72xd4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q598k\" (UID: \"dcec7653-0ad4-4599-9874-715c535aad5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:24.468360 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.468289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcec7653-0ad4-4599-9874-715c535aad5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q598k\" (UID: \"dcec7653-0ad4-4599-9874-715c535aad5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:24.468360 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.468330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a6f610-6518-4a5d-bbc6-a88d646faabe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpk2k\" (UID: \"02a6f610-6518-4a5d-bbc6-a88d646faabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:24.555169 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.555142    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.557562 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.557528    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkpvp\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:16:24.559364 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.559330    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.564966 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.564928    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5" container="manager"
Jul 09 17:16:24.565209 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.565190    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:16:24.566085 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.566063    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" containerID="e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57" exitCode=0
Jul 09 17:16:24.566184 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.566103    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.566184 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.566162    2579 scope.go:117] "RemoveContainer" containerID="e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57"
Jul 09 17:16:24.567227 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.567196    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkpvp\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:16:24.567402 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.567381    2579 generic.go:356] "Generic (PLEG): container finished" podID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" containerID="f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db" exitCode=0
Jul 09 17:16:24.567483 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.567415    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:16:24.568637 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.568616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72xd4\" (UniqueName: \"kubernetes.io/projected/dcec7653-0ad4-4599-9874-715c535aad5e-kube-api-access-72xd4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q598k\" (UID: \"dcec7653-0ad4-4599-9874-715c535aad5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:24.568741 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.568647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcec7653-0ad4-4599-9874-715c535aad5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q598k\" (UID: \"dcec7653-0ad4-4599-9874-715c535aad5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:24.568741 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.568676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a6f610-6518-4a5d-bbc6-a88d646faabe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpk2k\" (UID: \"02a6f610-6518-4a5d-bbc6-a88d646faabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:24.568741 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.568704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9kd2\" (UniqueName: \"kubernetes.io/projected/c6ae0d9e-0180-4a60-96b8-0db791e145f2-kube-api-access-n9kd2\") pod \"limitador-operator-controller-manager-859d7b78bd-lfbr2\" (UID: \"c6ae0d9e-0180-4a60-96b8-0db791e145f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"
Jul 09 17:16:24.568741 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.568731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnc4\" (UniqueName: \"kubernetes.io/projected/02a6f610-6518-4a5d-bbc6-a88d646faabe-kube-api-access-wqnc4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpk2k\" (UID: \"02a6f610-6518-4a5d-bbc6-a88d646faabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:24.569099 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.569065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a6f610-6518-4a5d-bbc6-a88d646faabe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpk2k\" (UID: \"02a6f610-6518-4a5d-bbc6-a88d646faabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:24.569171 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.569151    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcec7653-0ad4-4599-9874-715c535aad5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q598k\" (UID: \"dcec7653-0ad4-4599-9874-715c535aad5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:24.569210 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.569153    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.570962 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.570933    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:24.572711 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.572690    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:24.574506 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.574477    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkpvp\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkpvp"
Jul 09 17:16:24.574682 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.574667    2579 scope.go:117] "RemoveContainer" containerID="e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57"
Jul 09 17:16:24.575012 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.574988    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57\": container with ID starting with e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57 not found: ID does not exist" containerID="e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57"
Jul 09 17:16:24.575103 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.575021    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57"} err="failed to get container status \"e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57\": rpc error: code = NotFound desc = could not find container \"e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57\": container with ID starting with e776e8af806b55a592af0491d4bc4cd0f053020428ce2cc443577a0e56ddbc57 not found: ID does not exist"
Jul 09 17:16:24.575103 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.575039    2579 scope.go:117] "RemoveContainer" containerID="f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db"
Jul 09 17:16:24.576123 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.576104    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qrdtw\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrdtw"
Jul 09 17:16:24.583890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.582381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqnc4\" (UniqueName: \"kubernetes.io/projected/02a6f610-6518-4a5d-bbc6-a88d646faabe-kube-api-access-wqnc4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpk2k\" (UID: \"02a6f610-6518-4a5d-bbc6-a88d646faabe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:24.584419 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.584392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72xd4\" (UniqueName: \"kubernetes.io/projected/dcec7653-0ad4-4599-9874-715c535aad5e-kube-api-access-72xd4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q598k\" (UID: \"dcec7653-0ad4-4599-9874-715c535aad5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:24.584685 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.584658    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9kd2\" (UniqueName: \"kubernetes.io/projected/c6ae0d9e-0180-4a60-96b8-0db791e145f2-kube-api-access-n9kd2\") pod \"limitador-operator-controller-manager-859d7b78bd-lfbr2\" (UID: \"c6ae0d9e-0180-4a60-96b8-0db791e145f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"
Jul 09 17:16:24.588881 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.588840    2579 scope.go:117] "RemoveContainer" containerID="f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db"
Jul 09 17:16:24.589220 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:24.589201    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db\": container with ID starting with f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db not found: ID does not exist" containerID="f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db"
Jul 09 17:16:24.589271 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.589230    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db"} err="failed to get container status \"f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db\": rpc error: code = NotFound desc = could not find container \"f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db\": container with ID starting with f0ebae294050820687737427b09f0d6f6253aa5e2f59e55b2b1e2f1c1a3437db not found: ID does not exist"
Jul 09 17:16:24.623985 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.623944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:24.669310 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.669276    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-extensions-socket-volume\") pod \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\" (UID: \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\") "
Jul 09 17:16:24.669496 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.669336    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftz9m\" (UniqueName: \"kubernetes.io/projected/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-kube-api-access-ftz9m\") pod \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\" (UID: \"fe7c4fca-89ac-4a2b-9958-6523b7d7fed1\") "
Jul 09 17:16:24.669496 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.669370    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr7jq\" (UniqueName: \"kubernetes.io/projected/37f5c8b9-1c91-4a80-869c-e583eacdbae4-kube-api-access-xr7jq\") pod \"37f5c8b9-1c91-4a80-869c-e583eacdbae4\" (UID: \"37f5c8b9-1c91-4a80-869c-e583eacdbae4\") "
Jul 09 17:16:24.669884 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.669849    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" (UID: "fe7c4fca-89ac-4a2b-9958-6523b7d7fed1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:24.671638 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.671602    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-kube-api-access-ftz9m" (OuterVolumeSpecName: "kube-api-access-ftz9m") pod "fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" (UID: "fe7c4fca-89ac-4a2b-9958-6523b7d7fed1"). InnerVolumeSpecName "kube-api-access-ftz9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:24.671864 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.671675    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f5c8b9-1c91-4a80-869c-e583eacdbae4-kube-api-access-xr7jq" (OuterVolumeSpecName: "kube-api-access-xr7jq") pod "37f5c8b9-1c91-4a80-869c-e583eacdbae4" (UID: "37f5c8b9-1c91-4a80-869c-e583eacdbae4"). InnerVolumeSpecName "kube-api-access-xr7jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:24.721978 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.721946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:24.728720 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.728695    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"
Jul 09 17:16:24.770423 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.770322    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-extensions-socket-volume\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:24.770423 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.770363    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftz9m\" (UniqueName: \"kubernetes.io/projected/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1-kube-api-access-ftz9m\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:24.770423 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.770382    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr7jq\" (UniqueName: \"kubernetes.io/projected/37f5c8b9-1c91-4a80-869c-e583eacdbae4-kube-api-access-xr7jq\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:24.774825 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.774717    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"]
Jul 09 17:16:24.783651 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:16:24.783529    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcec7653_0ad4_4599_9874_715c535aad5e.slice/crio-702f2bafb2655b179a3789dd94d4f4c2e4c92bdaeb3dd8391654093531f4ff76 WatchSource:0}: Error finding container 702f2bafb2655b179a3789dd94d4f4c2e4c92bdaeb3dd8391654093531f4ff76: Status 404 returned error can't find the container with id 702f2bafb2655b179a3789dd94d4f4c2e4c92bdaeb3dd8391654093531f4ff76
Jul 09 17:16:24.838038 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.838000    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f5c8b9-1c91-4a80-869c-e583eacdbae4" path="/var/lib/kubelet/pods/37f5c8b9-1c91-4a80-869c-e583eacdbae4/volumes"
Jul 09 17:16:24.838547 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.838516    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7c4fca-89ac-4a2b-9958-6523b7d7fed1" path="/var/lib/kubelet/pods/fe7c4fca-89ac-4a2b-9958-6523b7d7fed1/volumes"
Jul 09 17:16:24.918232 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.918207    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"]
Jul 09 17:16:24.920728 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:16:24.920697    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ae0d9e_0180_4a60_96b8_0db791e145f2.slice/crio-eed23decb2cca0aeac65a306b7c1b78c643f39fa4eb0df36d5c8fb8f60e3f108 WatchSource:0}: Error finding container eed23decb2cca0aeac65a306b7c1b78c643f39fa4eb0df36d5c8fb8f60e3f108: Status 404 returned error can't find the container with id eed23decb2cca0aeac65a306b7c1b78c643f39fa4eb0df36d5c8fb8f60e3f108
Jul 09 17:16:24.934859 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:24.934704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"]
Jul 09 17:16:24.937664 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:16:24.937636    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a6f610_6518_4a5d_bbc6_a88d646faabe.slice/crio-c7ae8e70e8cd4745331cb8f83f7d6d84897c216dd6ed3e50e25accc4eb0a7334 WatchSource:0}: Error finding container c7ae8e70e8cd4745331cb8f83f7d6d84897c216dd6ed3e50e25accc4eb0a7334: Status 404 returned error can't find the container with id c7ae8e70e8cd4745331cb8f83f7d6d84897c216dd6ed3e50e25accc4eb0a7334
Jul 09 17:16:25.280175 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.280104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:25.380690 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.380656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:25.575278 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.575175    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" containerName="manager" containerID="cri-o://627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44" gracePeriod=2
Jul 09 17:16:25.578692 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.578648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2" event={"ID":"c6ae0d9e-0180-4a60-96b8-0db791e145f2","Type":"ContainerStarted","Data":"0a9901c4990ab9dea2bb0fdbd4a2b83a6e5c28936c4ba91dc2584046b4c33310"}
Jul 09 17:16:25.578875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.578721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2" event={"ID":"c6ae0d9e-0180-4a60-96b8-0db791e145f2","Type":"ContainerStarted","Data":"eed23decb2cca0aeac65a306b7c1b78c643f39fa4eb0df36d5c8fb8f60e3f108"}
Jul 09 17:16:25.578875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.578844    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"
Jul 09 17:16:25.581009 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.580556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k" event={"ID":"dcec7653-0ad4-4599-9874-715c535aad5e","Type":"ContainerStarted","Data":"59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64"}
Jul 09 17:16:25.581009 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.580606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k" event={"ID":"dcec7653-0ad4-4599-9874-715c535aad5e","Type":"ContainerStarted","Data":"702f2bafb2655b179a3789dd94d4f4c2e4c92bdaeb3dd8391654093531f4ff76"}
Jul 09 17:16:25.581009 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.580657    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:25.582123 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.582103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k" event={"ID":"02a6f610-6518-4a5d-bbc6-a88d646faabe","Type":"ContainerStarted","Data":"ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146"}
Jul 09 17:16:25.582202 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.582143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k" event={"ID":"02a6f610-6518-4a5d-bbc6-a88d646faabe","Type":"ContainerStarted","Data":"c7ae8e70e8cd4745331cb8f83f7d6d84897c216dd6ed3e50e25accc4eb0a7334"}
Jul 09 17:16:25.582202 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.582171    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:25.601964 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.601913    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2" podStartSLOduration=1.601897718 podStartE2EDuration="1.601897718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:25.600636047 +0000 UTC m=+455.307848985" watchObservedRunningTime="2026-07-09 17:16:25.601897718 +0000 UTC m=+455.309110747"
Jul 09 17:16:25.618089 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.618040    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k" podStartSLOduration=1.61802442 podStartE2EDuration="1.61802442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:25.616772654 +0000 UTC m=+455.323985601" watchObservedRunningTime="2026-07-09 17:16:25.61802442 +0000 UTC m=+455.325237366"
Jul 09 17:16:25.637116 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.637063    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k" podStartSLOduration=1.637042996 podStartE2EDuration="1.637042996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:25.635585175 +0000 UTC m=+455.342798139" watchObservedRunningTime="2026-07-09 17:16:25.637042996 +0000 UTC m=+455.344255943"
Jul 09 17:16:25.827111 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.827039    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:25.829228 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:25.829196    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:25.888095 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.888059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:25.982093 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.982056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pv9l\" (UniqueName: \"kubernetes.io/projected/d47fb529-9350-44c8-b21c-e1ce51b5db9f-kube-api-access-4pv9l\") pod \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\" (UID: \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\") "
Jul 09 17:16:25.982267 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.982157    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d47fb529-9350-44c8-b21c-e1ce51b5db9f-extensions-socket-volume\") pod \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\" (UID: \"d47fb529-9350-44c8-b21c-e1ce51b5db9f\") "
Jul 09 17:16:25.982424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.982399    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47fb529-9350-44c8-b21c-e1ce51b5db9f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d47fb529-9350-44c8-b21c-e1ce51b5db9f" (UID: "d47fb529-9350-44c8-b21c-e1ce51b5db9f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:25.983425 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.983404    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:25.984197 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:25.984175    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47fb529-9350-44c8-b21c-e1ce51b5db9f-kube-api-access-4pv9l" (OuterVolumeSpecName: "kube-api-access-4pv9l") pod "d47fb529-9350-44c8-b21c-e1ce51b5db9f" (UID: "d47fb529-9350-44c8-b21c-e1ce51b5db9f"). InnerVolumeSpecName "kube-api-access-4pv9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:26.082929 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:26.082803    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d47fb529-9350-44c8-b21c-e1ce51b5db9f-extensions-socket-volume\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:26.082929 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:26.082869    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pv9l\" (UniqueName: \"kubernetes.io/projected/d47fb529-9350-44c8-b21c-e1ce51b5db9f-kube-api-access-4pv9l\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:26.588684 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:26.588649    2579 generic.go:356] "Generic (PLEG): container finished" podID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" containerID="627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44" exitCode=2
Jul 09 17:16:26.589148 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:26.588698    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:26.589148 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:26.588748    2579 scope.go:117] "RemoveContainer" containerID="627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44"
Jul 09 17:16:26.590928 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:26.590901    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:26.598680 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:26.598656    2579 scope.go:117] "RemoveContainer" containerID="627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44"
Jul 09 17:16:26.599181 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:26.599152    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44\": container with ID starting with 627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44 not found: ID does not exist" containerID="627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44"
Jul 09 17:16:26.599291 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:26.599195    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44"} err="failed to get container status \"627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44\": rpc error: code = NotFound desc = could not find container \"627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44\": container with ID starting with 627158a6ead0ed3ed8dce5a40ee7a8815c794b7559a505404d097a015c877d44 not found: ID does not exist"
Jul 09 17:16:26.601664 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:26.601640    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6tq5\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6tq5"
Jul 09 17:16:26.816791 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:26.816757    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d47fb529-9350-44c8-b21c-e1ce51b5db9f" path="/var/lib/kubelet/pods/d47fb529-9350-44c8-b21c-e1ce51b5db9f/volumes"
Jul 09 17:16:29.263664 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:29.263633    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:29.365727 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:29.365697    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:31.471634 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:31.471596    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:31.543315 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:31.543287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:36.010549 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.010494    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:36.110597 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.110564    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:36.591122 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.591097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:36.591312 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.591172    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfbr2"
Jul 09 17:16:36.591312 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.591293    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:36.673458 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.673426    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"]
Jul 09 17:16:36.673685 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.673642    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k" podUID="02a6f610-6518-4a5d-bbc6-a88d646faabe" containerName="manager" containerID="cri-o://ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146" gracePeriod=10
Jul 09 17:16:36.926509 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.926483    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:36.967057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.967027    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"]
Jul 09 17:16:36.967378 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.967366    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a6f610-6518-4a5d-bbc6-a88d646faabe" containerName="manager"
Jul 09 17:16:36.967426 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.967379    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a6f610-6518-4a5d-bbc6-a88d646faabe" containerName="manager"
Jul 09 17:16:36.967461 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.967436    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a6f610-6518-4a5d-bbc6-a88d646faabe" containerName="manager"
Jul 09 17:16:36.969424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.969408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:36.982521 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:36.982488    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"]
Jul 09 17:16:37.075314 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.075275    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqnc4\" (UniqueName: \"kubernetes.io/projected/02a6f610-6518-4a5d-bbc6-a88d646faabe-kube-api-access-wqnc4\") pod \"02a6f610-6518-4a5d-bbc6-a88d646faabe\" (UID: \"02a6f610-6518-4a5d-bbc6-a88d646faabe\") "
Jul 09 17:16:37.075314 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.075312    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a6f610-6518-4a5d-bbc6-a88d646faabe-extensions-socket-volume\") pod \"02a6f610-6518-4a5d-bbc6-a88d646faabe\" (UID: \"02a6f610-6518-4a5d-bbc6-a88d646faabe\") "
Jul 09 17:16:37.075722 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.075417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd69l\" (UniqueName: \"kubernetes.io/projected/19673264-8b8d-428e-85b9-ecec5f2cd156-kube-api-access-gd69l\") pod \"kuadrant-operator-controller-manager-86878c769f-v7ct9\" (UID: \"19673264-8b8d-428e-85b9-ecec5f2cd156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:37.075722 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.075459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19673264-8b8d-428e-85b9-ecec5f2cd156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7ct9\" (UID: \"19673264-8b8d-428e-85b9-ecec5f2cd156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:37.075801 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.075745    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02a6f610-6518-4a5d-bbc6-a88d646faabe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "02a6f610-6518-4a5d-bbc6-a88d646faabe" (UID: "02a6f610-6518-4a5d-bbc6-a88d646faabe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:37.077508 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.077484    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a6f610-6518-4a5d-bbc6-a88d646faabe-kube-api-access-wqnc4" (OuterVolumeSpecName: "kube-api-access-wqnc4") pod "02a6f610-6518-4a5d-bbc6-a88d646faabe" (UID: "02a6f610-6518-4a5d-bbc6-a88d646faabe"). InnerVolumeSpecName "kube-api-access-wqnc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:37.176675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.176585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd69l\" (UniqueName: \"kubernetes.io/projected/19673264-8b8d-428e-85b9-ecec5f2cd156-kube-api-access-gd69l\") pod \"kuadrant-operator-controller-manager-86878c769f-v7ct9\" (UID: \"19673264-8b8d-428e-85b9-ecec5f2cd156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:37.176675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.176635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19673264-8b8d-428e-85b9-ecec5f2cd156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7ct9\" (UID: \"19673264-8b8d-428e-85b9-ecec5f2cd156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:37.176675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.176671    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqnc4\" (UniqueName: \"kubernetes.io/projected/02a6f610-6518-4a5d-bbc6-a88d646faabe-kube-api-access-wqnc4\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:37.176934 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.176686    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a6f610-6518-4a5d-bbc6-a88d646faabe-extensions-socket-volume\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:37.177050 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.177033    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19673264-8b8d-428e-85b9-ecec5f2cd156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7ct9\" (UID: \"19673264-8b8d-428e-85b9-ecec5f2cd156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:37.185363 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.185337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd69l\" (UniqueName: \"kubernetes.io/projected/19673264-8b8d-428e-85b9-ecec5f2cd156-kube-api-access-gd69l\") pod \"kuadrant-operator-controller-manager-86878c769f-v7ct9\" (UID: \"19673264-8b8d-428e-85b9-ecec5f2cd156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:37.279704 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.279666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:37.421479 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.421446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"]
Jul 09 17:16:37.424639 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:16:37.424609    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19673264_8b8d_428e_85b9_ecec5f2cd156.slice/crio-e6d6d917d1d18481b3e7fc6a31369d522410351dec1c8f33efce4595a7bbd234 WatchSource:0}: Error finding container e6d6d917d1d18481b3e7fc6a31369d522410351dec1c8f33efce4595a7bbd234: Status 404 returned error can't find the container with id e6d6d917d1d18481b3e7fc6a31369d522410351dec1c8f33efce4595a7bbd234
Jul 09 17:16:37.643431 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.643382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9" event={"ID":"19673264-8b8d-428e-85b9-ecec5f2cd156","Type":"ContainerStarted","Data":"8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62"}
Jul 09 17:16:37.643627 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.643444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9" event={"ID":"19673264-8b8d-428e-85b9-ecec5f2cd156","Type":"ContainerStarted","Data":"e6d6d917d1d18481b3e7fc6a31369d522410351dec1c8f33efce4595a7bbd234"}
Jul 09 17:16:37.643627 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.643471    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:37.644771 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.644740    2579 generic.go:356] "Generic (PLEG): container finished" podID="02a6f610-6518-4a5d-bbc6-a88d646faabe" containerID="ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146" exitCode=0
Jul 09 17:16:37.644931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.644790    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"
Jul 09 17:16:37.644931 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.644790    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k" event={"ID":"02a6f610-6518-4a5d-bbc6-a88d646faabe","Type":"ContainerDied","Data":"ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146"}
Jul 09 17:16:37.645043 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.644949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k" event={"ID":"02a6f610-6518-4a5d-bbc6-a88d646faabe","Type":"ContainerDied","Data":"c7ae8e70e8cd4745331cb8f83f7d6d84897c216dd6ed3e50e25accc4eb0a7334"}
Jul 09 17:16:37.645043 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.644993    2579 scope.go:117] "RemoveContainer" containerID="ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146"
Jul 09 17:16:37.654262 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.654244    2579 scope.go:117] "RemoveContainer" containerID="ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146"
Jul 09 17:16:37.654590 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:37.654567    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146\": container with ID starting with ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146 not found: ID does not exist" containerID="ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146"
Jul 09 17:16:37.654634 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.654602    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146"} err="failed to get container status \"ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146\": rpc error: code = NotFound desc = could not find container \"ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146\": container with ID starting with ab11ca9c08199c23c03d30b384af5d76a4fc75d0f92caba5de85359650f62146 not found: ID does not exist"
Jul 09 17:16:37.663777 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.663701    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9" podStartSLOduration=1.663683161 podStartE2EDuration="1.663683161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:37.66260964 +0000 UTC m=+467.369822598" watchObservedRunningTime="2026-07-09 17:16:37.663683161 +0000 UTC m=+467.370896107"
Jul 09 17:16:37.677445 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.677413    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"]
Jul 09 17:16:37.682879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:37.682799    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpk2k"]
Jul 09 17:16:38.817573 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:38.817537    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a6f610-6518-4a5d-bbc6-a88d646faabe" path="/var/lib/kubelet/pods/02a6f610-6518-4a5d-bbc6-a88d646faabe/volumes"
Jul 09 17:16:48.653032 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:48.652990    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:16:48.699063 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:48.699032    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"]
Jul 09 17:16:48.699266 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:48.699229    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k" podUID="dcec7653-0ad4-4599-9874-715c535aad5e" containerName="manager" containerID="cri-o://59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64" gracePeriod=10
Jul 09 17:16:48.958463 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:48.958438    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:49.073220 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.073190    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcec7653-0ad4-4599-9874-715c535aad5e-extensions-socket-volume\") pod \"dcec7653-0ad4-4599-9874-715c535aad5e\" (UID: \"dcec7653-0ad4-4599-9874-715c535aad5e\") "
Jul 09 17:16:49.073416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.073280    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72xd4\" (UniqueName: \"kubernetes.io/projected/dcec7653-0ad4-4599-9874-715c535aad5e-kube-api-access-72xd4\") pod \"dcec7653-0ad4-4599-9874-715c535aad5e\" (UID: \"dcec7653-0ad4-4599-9874-715c535aad5e\") "
Jul 09 17:16:49.073591 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.073564    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcec7653-0ad4-4599-9874-715c535aad5e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dcec7653-0ad4-4599-9874-715c535aad5e" (UID: "dcec7653-0ad4-4599-9874-715c535aad5e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:49.075438 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.075411    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcec7653-0ad4-4599-9874-715c535aad5e-kube-api-access-72xd4" (OuterVolumeSpecName: "kube-api-access-72xd4") pod "dcec7653-0ad4-4599-9874-715c535aad5e" (UID: "dcec7653-0ad4-4599-9874-715c535aad5e"). InnerVolumeSpecName "kube-api-access-72xd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:49.174527 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.174484    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcec7653-0ad4-4599-9874-715c535aad5e-extensions-socket-volume\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:49.174527 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.174516    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72xd4\" (UniqueName: \"kubernetes.io/projected/dcec7653-0ad4-4599-9874-715c535aad5e-kube-api-access-72xd4\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:16:49.702521 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.702488    2579 generic.go:356] "Generic (PLEG): container finished" podID="dcec7653-0ad4-4599-9874-715c535aad5e" containerID="59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64" exitCode=0
Jul 09 17:16:49.702988 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.702532    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"
Jul 09 17:16:49.702988 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.702551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k" event={"ID":"dcec7653-0ad4-4599-9874-715c535aad5e","Type":"ContainerDied","Data":"59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64"}
Jul 09 17:16:49.702988 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.702593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k" event={"ID":"dcec7653-0ad4-4599-9874-715c535aad5e","Type":"ContainerDied","Data":"702f2bafb2655b179a3789dd94d4f4c2e4c92bdaeb3dd8391654093531f4ff76"}
Jul 09 17:16:49.702988 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.702614    2579 scope.go:117] "RemoveContainer" containerID="59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64"
Jul 09 17:16:49.711557 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.711539    2579 scope.go:117] "RemoveContainer" containerID="59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64"
Jul 09 17:16:49.711882 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:16:49.711861    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64\": container with ID starting with 59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64 not found: ID does not exist" containerID="59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64"
Jul 09 17:16:49.711941 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.711892    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64"} err="failed to get container status \"59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64\": rpc error: code = NotFound desc = could not find container \"59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64\": container with ID starting with 59826d19c8dd660fcab43f8b4818682df7b4cbe419befac8235b6920b27c0c64 not found: ID does not exist"
Jul 09 17:16:49.724431 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.724398    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"]
Jul 09 17:16:49.733058 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:49.733029    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q598k"]
Jul 09 17:16:50.815168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:50.815132    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcec7653-0ad4-4599-9874-715c535aad5e" path="/var/lib/kubelet/pods/dcec7653-0ad4-4599-9874-715c535aad5e/volumes"
Jul 09 17:16:53.037867 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:53.037828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:53.695000 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:53.694969    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:54.141140 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:54.141104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:16:54.195424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:16:54.195394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:08.581643 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.581602    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfl69"]
Jul 09 17:17:08.582213 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.582054    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcec7653-0ad4-4599-9874-715c535aad5e" containerName="manager"
Jul 09 17:17:08.582213 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.582069    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcec7653-0ad4-4599-9874-715c535aad5e" containerName="manager"
Jul 09 17:17:08.582213 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.582140    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcec7653-0ad4-4599-9874-715c535aad5e" containerName="manager"
Jul 09 17:17:08.582373 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.582353    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:08.585267 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.585249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:08.587917 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.587894    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 17:17:08.588082 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.587895    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2nr4r\""
Jul 09 17:17:08.593938 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.593903    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfl69"]
Jul 09 17:17:08.617710 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.617681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2ab55d81-72ae-4908-bf02-641040fc52e9-config-file\") pod \"limitador-limitador-64c94fd64f-hfl69\" (UID: \"2ab55d81-72ae-4908-bf02-641040fc52e9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:08.617901 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.617738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p976\" (UniqueName: \"kubernetes.io/projected/2ab55d81-72ae-4908-bf02-641040fc52e9-kube-api-access-7p976\") pod \"limitador-limitador-64c94fd64f-hfl69\" (UID: \"2ab55d81-72ae-4908-bf02-641040fc52e9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:08.686826 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.686768    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfl69"]
Jul 09 17:17:08.697238 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.697207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:08.718528 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.718491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p976\" (UniqueName: \"kubernetes.io/projected/2ab55d81-72ae-4908-bf02-641040fc52e9-kube-api-access-7p976\") pod \"limitador-limitador-64c94fd64f-hfl69\" (UID: \"2ab55d81-72ae-4908-bf02-641040fc52e9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:08.718683 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.718537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2ab55d81-72ae-4908-bf02-641040fc52e9-config-file\") pod \"limitador-limitador-64c94fd64f-hfl69\" (UID: \"2ab55d81-72ae-4908-bf02-641040fc52e9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:08.719140 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.719121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2ab55d81-72ae-4908-bf02-641040fc52e9-config-file\") pod \"limitador-limitador-64c94fd64f-hfl69\" (UID: \"2ab55d81-72ae-4908-bf02-641040fc52e9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:08.733523 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.733490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p976\" (UniqueName: \"kubernetes.io/projected/2ab55d81-72ae-4908-bf02-641040fc52e9-kube-api-access-7p976\") pod \"limitador-limitador-64c94fd64f-hfl69\" (UID: \"2ab55d81-72ae-4908-bf02-641040fc52e9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:08.810615 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.810542    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:08.896298 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:08.896197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:09.037586 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.037548    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfl69"]
Jul 09 17:17:09.040901 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:17:09.040866    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab55d81_72ae_4908_bf02_641040fc52e9.slice/crio-c43100344a7e341fbf77495ea40a5550fb1b07b4726d00541734c3f85d8e2fe1 WatchSource:0}: Error finding container c43100344a7e341fbf77495ea40a5550fb1b07b4726d00541734c3f85d8e2fe1: Status 404 returned error can't find the container with id c43100344a7e341fbf77495ea40a5550fb1b07b4726d00541734c3f85d8e2fe1
Jul 09 17:17:09.385545 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.385504    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-5zlrh"]
Jul 09 17:17:09.389549 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.389524    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5zlrh"
Jul 09 17:17:09.391804 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.391783    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-crqqs\""
Jul 09 17:17:09.396171 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.396138    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5zlrh"]
Jul 09 17:17:09.415201 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.415169    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:09.424373 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.424342    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nmsw\" (UniqueName: \"kubernetes.io/projected/49164ff4-3248-411f-ac29-8cc2427ae7cb-kube-api-access-6nmsw\") pod \"authorino-58cd955675-5zlrh\" (UID: \"49164ff4-3248-411f-ac29-8cc2427ae7cb\") " pod="kuadrant-system/authorino-58cd955675-5zlrh"
Jul 09 17:17:09.475531 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.475501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:09.525025 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.524981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nmsw\" (UniqueName: \"kubernetes.io/projected/49164ff4-3248-411f-ac29-8cc2427ae7cb-kube-api-access-6nmsw\") pod \"authorino-58cd955675-5zlrh\" (UID: \"49164ff4-3248-411f-ac29-8cc2427ae7cb\") " pod="kuadrant-system/authorino-58cd955675-5zlrh"
Jul 09 17:17:09.533306 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.533275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nmsw\" (UniqueName: \"kubernetes.io/projected/49164ff4-3248-411f-ac29-8cc2427ae7cb-kube-api-access-6nmsw\") pod \"authorino-58cd955675-5zlrh\" (UID: \"49164ff4-3248-411f-ac29-8cc2427ae7cb\") " pod="kuadrant-system/authorino-58cd955675-5zlrh"
Jul 09 17:17:09.700707 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.700614    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5zlrh"
Jul 09 17:17:09.787045 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.787010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69" event={"ID":"2ab55d81-72ae-4908-bf02-641040fc52e9","Type":"ContainerStarted","Data":"c43100344a7e341fbf77495ea40a5550fb1b07b4726d00541734c3f85d8e2fe1"}
Jul 09 17:17:09.850989 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:09.850959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5zlrh"]
Jul 09 17:17:09.860039 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:17:09.855837    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49164ff4_3248_411f_ac29_8cc2427ae7cb.slice/crio-ea1880471706a5310f6cb8c57cd567badb9a555747b24b89f53eedd36fa8f8f1 WatchSource:0}: Error finding container ea1880471706a5310f6cb8c57cd567badb9a555747b24b89f53eedd36fa8f8f1: Status 404 returned error can't find the container with id ea1880471706a5310f6cb8c57cd567badb9a555747b24b89f53eedd36fa8f8f1
Jul 09 17:17:10.793291 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:10.793246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5zlrh" event={"ID":"49164ff4-3248-411f-ac29-8cc2427ae7cb","Type":"ContainerStarted","Data":"ea1880471706a5310f6cb8c57cd567badb9a555747b24b89f53eedd36fa8f8f1"}
Jul 09 17:17:12.807186 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:12.807146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69" event={"ID":"2ab55d81-72ae-4908-bf02-641040fc52e9","Type":"ContainerStarted","Data":"f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639"}
Jul 09 17:17:12.807616 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:12.807384    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:12.823764 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:12.823700    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69" podStartSLOduration=2.027313633 podStartE2EDuration="4.823681285s" totalImagesPullingTime="2.796367652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:17:12.822382524 +0000 UTC m=+502.529595471" watchObservedRunningTime="2026-07-09 17:17:12.823681285 +0000 UTC m=+502.530894230"
Jul 09 17:17:14.556182 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:14.556149    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5zlrh"]
Jul 09 17:17:14.817708 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:14.817668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5zlrh" event={"ID":"49164ff4-3248-411f-ac29-8cc2427ae7cb","Type":"ContainerStarted","Data":"f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935"}
Jul 09 17:17:14.832069 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:14.832017    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-5zlrh" podStartSLOduration=1.235720773 podStartE2EDuration="5.831997083s" totalImagesPullingTime="4.59627631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:17:14.83075736 +0000 UTC m=+504.537970298" watchObservedRunningTime="2026-07-09 17:17:14.831997083 +0000 UTC m=+504.539210067"
Jul 09 17:17:15.821869 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:15.821831    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-5zlrh" podUID="49164ff4-3248-411f-ac29-8cc2427ae7cb" containerName="authorino" containerID="cri-o://f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935" gracePeriod=30
Jul 09 17:17:16.069526 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.069499    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5zlrh"
Jul 09 17:17:16.183519 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.183427    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nmsw\" (UniqueName: \"kubernetes.io/projected/49164ff4-3248-411f-ac29-8cc2427ae7cb-kube-api-access-6nmsw\") pod \"49164ff4-3248-411f-ac29-8cc2427ae7cb\" (UID: \"49164ff4-3248-411f-ac29-8cc2427ae7cb\") "
Jul 09 17:17:16.185379 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.185354    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49164ff4-3248-411f-ac29-8cc2427ae7cb-kube-api-access-6nmsw" (OuterVolumeSpecName: "kube-api-access-6nmsw") pod "49164ff4-3248-411f-ac29-8cc2427ae7cb" (UID: "49164ff4-3248-411f-ac29-8cc2427ae7cb"). InnerVolumeSpecName "kube-api-access-6nmsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:17:16.284093 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.284057    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nmsw\" (UniqueName: \"kubernetes.io/projected/49164ff4-3248-411f-ac29-8cc2427ae7cb-kube-api-access-6nmsw\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:17:16.826769 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.826739    2579 generic.go:356] "Generic (PLEG): container finished" podID="49164ff4-3248-411f-ac29-8cc2427ae7cb" containerID="f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935" exitCode=0
Jul 09 17:17:16.827131 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.826781    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5zlrh"
Jul 09 17:17:16.827131 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.826840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5zlrh" event={"ID":"49164ff4-3248-411f-ac29-8cc2427ae7cb","Type":"ContainerDied","Data":"f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935"}
Jul 09 17:17:16.827131 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.826888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5zlrh" event={"ID":"49164ff4-3248-411f-ac29-8cc2427ae7cb","Type":"ContainerDied","Data":"ea1880471706a5310f6cb8c57cd567badb9a555747b24b89f53eedd36fa8f8f1"}
Jul 09 17:17:16.827131 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.826908    2579 scope.go:117] "RemoveContainer" containerID="f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935"
Jul 09 17:17:16.835184 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.835159    2579 scope.go:117] "RemoveContainer" containerID="f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935"
Jul 09 17:17:16.835503 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:17:16.835483    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935\": container with ID starting with f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935 not found: ID does not exist" containerID="f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935"
Jul 09 17:17:16.835545 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.835514    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935"} err="failed to get container status \"f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935\": rpc error: code = NotFound desc = could not find container \"f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935\": container with ID starting with f28da5014ec9f8c00001f1bb80ca6149f06605a4b33f6a9a614e2c0b3c672935 not found: ID does not exist"
Jul 09 17:17:16.840995 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.840966    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5zlrh"]
Jul 09 17:17:16.844315 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:16.844286    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-5zlrh"]
Jul 09 17:17:18.815410 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:18.815379    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49164ff4-3248-411f-ac29-8cc2427ae7cb" path="/var/lib/kubelet/pods/49164ff4-3248-411f-ac29-8cc2427ae7cb/volumes"
Jul 09 17:17:23.553367 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:23.553332    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfl69"]
Jul 09 17:17:23.553846 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:23.553504    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69" podUID="2ab55d81-72ae-4908-bf02-641040fc52e9" containerName="limitador" containerID="cri-o://f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639" gracePeriod=30
Jul 09 17:17:23.554196 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:23.554179    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:24.109058 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.109032    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:24.153233 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.153126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p976\" (UniqueName: \"kubernetes.io/projected/2ab55d81-72ae-4908-bf02-641040fc52e9-kube-api-access-7p976\") pod \"2ab55d81-72ae-4908-bf02-641040fc52e9\" (UID: \"2ab55d81-72ae-4908-bf02-641040fc52e9\") "
Jul 09 17:17:24.153233 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.153189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2ab55d81-72ae-4908-bf02-641040fc52e9-config-file\") pod \"2ab55d81-72ae-4908-bf02-641040fc52e9\" (UID: \"2ab55d81-72ae-4908-bf02-641040fc52e9\") "
Jul 09 17:17:24.153566 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.153542    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab55d81-72ae-4908-bf02-641040fc52e9-config-file" (OuterVolumeSpecName: "config-file") pod "2ab55d81-72ae-4908-bf02-641040fc52e9" (UID: "2ab55d81-72ae-4908-bf02-641040fc52e9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:17:24.155275 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.155240    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab55d81-72ae-4908-bf02-641040fc52e9-kube-api-access-7p976" (OuterVolumeSpecName: "kube-api-access-7p976") pod "2ab55d81-72ae-4908-bf02-641040fc52e9" (UID: "2ab55d81-72ae-4908-bf02-641040fc52e9"). InnerVolumeSpecName "kube-api-access-7p976". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:17:24.254124 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.254086    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p976\" (UniqueName: \"kubernetes.io/projected/2ab55d81-72ae-4908-bf02-641040fc52e9-kube-api-access-7p976\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:17:24.254124 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.254117    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2ab55d81-72ae-4908-bf02-641040fc52e9-config-file\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:17:24.862785 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.862752    2579 generic.go:356] "Generic (PLEG): container finished" podID="2ab55d81-72ae-4908-bf02-641040fc52e9" containerID="f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639" exitCode=0
Jul 09 17:17:24.863242 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.862798    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69"
Jul 09 17:17:24.863242 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.862840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69" event={"ID":"2ab55d81-72ae-4908-bf02-641040fc52e9","Type":"ContainerDied","Data":"f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639"}
Jul 09 17:17:24.863242 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.862896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfl69" event={"ID":"2ab55d81-72ae-4908-bf02-641040fc52e9","Type":"ContainerDied","Data":"c43100344a7e341fbf77495ea40a5550fb1b07b4726d00541734c3f85d8e2fe1"}
Jul 09 17:17:24.863242 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.862923    2579 scope.go:117] "RemoveContainer" containerID="f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639"
Jul 09 17:17:24.871203 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.871172    2579 scope.go:117] "RemoveContainer" containerID="f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639"
Jul 09 17:17:24.871511 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:17:24.871491    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639\": container with ID starting with f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639 not found: ID does not exist" containerID="f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639"
Jul 09 17:17:24.871573 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.871522    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639"} err="failed to get container status \"f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639\": rpc error: code = NotFound desc = could not find container \"f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639\": container with ID starting with f7980112686b002821a1fa9b95823f56bc5f4313360d76f8ab3bf9e405a95639 not found: ID does not exist"
Jul 09 17:17:24.878289 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.878257    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfl69"]
Jul 09 17:17:24.882270 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:24.882242    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfl69"]
Jul 09 17:17:26.815652 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:26.815616    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab55d81-72ae-4908-bf02-641040fc52e9" path="/var/lib/kubelet/pods/2ab55d81-72ae-4908-bf02-641040fc52e9/volumes"
Jul 09 17:17:27.209365 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.209273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:27.306159 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.306119    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:27.717735 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.717705    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"]
Jul 09 17:17:27.718089 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.718073    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49164ff4-3248-411f-ac29-8cc2427ae7cb" containerName="authorino"
Jul 09 17:17:27.718089 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.718089    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="49164ff4-3248-411f-ac29-8cc2427ae7cb" containerName="authorino"
Jul 09 17:17:27.718224 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.718108    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab55d81-72ae-4908-bf02-641040fc52e9" containerName="limitador"
Jul 09 17:17:27.718224 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.718115    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab55d81-72ae-4908-bf02-641040fc52e9" containerName="limitador"
Jul 09 17:17:27.718224 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.718164    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="49164ff4-3248-411f-ac29-8cc2427ae7cb" containerName="authorino"
Jul 09 17:17:27.718224 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.718174    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab55d81-72ae-4908-bf02-641040fc52e9" containerName="limitador"
Jul 09 17:17:27.721147 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.721124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:27.723753 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.723729    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 17:17:27.723753 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.723744    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 17:17:27.724549 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.724532    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 17:17:27.724647 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.724605    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-s6tx6\""
Jul 09 17:17:27.729358 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.728969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"]
Jul 09 17:17:27.759806 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.759772    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:27.782008 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.781971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce96d7b5-2e94-4b78-9d87-92d0d781d06e-data\") pod \"postgres-69fb4594cf-wzpwm\" (UID: \"ce96d7b5-2e94-4b78-9d87-92d0d781d06e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:27.782126 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.782039    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzbqb\" (UniqueName: \"kubernetes.io/projected/ce96d7b5-2e94-4b78-9d87-92d0d781d06e-kube-api-access-vzbqb\") pod \"postgres-69fb4594cf-wzpwm\" (UID: \"ce96d7b5-2e94-4b78-9d87-92d0d781d06e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:27.883371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.883341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce96d7b5-2e94-4b78-9d87-92d0d781d06e-data\") pod \"postgres-69fb4594cf-wzpwm\" (UID: \"ce96d7b5-2e94-4b78-9d87-92d0d781d06e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:27.883758 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.883395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzbqb\" (UniqueName: \"kubernetes.io/projected/ce96d7b5-2e94-4b78-9d87-92d0d781d06e-kube-api-access-vzbqb\") pod \"postgres-69fb4594cf-wzpwm\" (UID: \"ce96d7b5-2e94-4b78-9d87-92d0d781d06e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:27.883758 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.883723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce96d7b5-2e94-4b78-9d87-92d0d781d06e-data\") pod \"postgres-69fb4594cf-wzpwm\" (UID: \"ce96d7b5-2e94-4b78-9d87-92d0d781d06e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:27.891552 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:27.891524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzbqb\" (UniqueName: \"kubernetes.io/projected/ce96d7b5-2e94-4b78-9d87-92d0d781d06e-kube-api-access-vzbqb\") pod \"postgres-69fb4594cf-wzpwm\" (UID: \"ce96d7b5-2e94-4b78-9d87-92d0d781d06e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:28.033492 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:28.033458    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:28.166628 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:28.166599    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"]
Jul 09 17:17:28.169247 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:17:28.169222    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce96d7b5_2e94_4b78_9d87_92d0d781d06e.slice/crio-93e0c2422ee32102d355fd42ec1fc83b06fe87cbd8886adf9cc2b804f36ba9d3 WatchSource:0}: Error finding container 93e0c2422ee32102d355fd42ec1fc83b06fe87cbd8886adf9cc2b804f36ba9d3: Status 404 returned error can't find the container with id 93e0c2422ee32102d355fd42ec1fc83b06fe87cbd8886adf9cc2b804f36ba9d3
Jul 09 17:17:28.440741 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:28.440652    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:28.887081 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:28.887044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm" event={"ID":"ce96d7b5-2e94-4b78-9d87-92d0d781d06e","Type":"ContainerStarted","Data":"93e0c2422ee32102d355fd42ec1fc83b06fe87cbd8886adf9cc2b804f36ba9d3"}
Jul 09 17:17:33.915482 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:33.915439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm" event={"ID":"ce96d7b5-2e94-4b78-9d87-92d0d781d06e","Type":"ContainerStarted","Data":"33567dd4f76a6a4014323578e29744c621cdb7b5a5fa4d9c8df390a5c33e8d59"}
Jul 09 17:17:33.915894 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:33.915511    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:33.930844 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:33.930772    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm" podStartSLOduration=2.214177274 podStartE2EDuration="6.930755552s" totalImagesPullingTime="4.716578278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:17:33.930220316 +0000 UTC m=+523.637433283" watchObservedRunningTime="2026-07-09 17:17:33.930755552 +0000 UTC m=+523.637968497"
Jul 09 17:17:39.949841 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:39.949789    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wzpwm"
Jul 09 17:17:40.485046 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.485010    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks2jm"]
Jul 09 17:17:40.488662 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.488637    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ks2jm"
Jul 09 17:17:40.490917 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.490895    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-crqqs\""
Jul 09 17:17:40.494696 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.494671    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks2jm"]
Jul 09 17:17:40.593523 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.593492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n6nk\" (UniqueName: \"kubernetes.io/projected/bd411cdd-bc45-49ed-9c1f-17506b8979b7-kube-api-access-4n6nk\") pod \"authorino-5d4b67c446-ks2jm\" (UID: \"bd411cdd-bc45-49ed-9c1f-17506b8979b7\") " pod="kuadrant-system/authorino-5d4b67c446-ks2jm"
Jul 09 17:17:40.694206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.694167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n6nk\" (UniqueName: \"kubernetes.io/projected/bd411cdd-bc45-49ed-9c1f-17506b8979b7-kube-api-access-4n6nk\") pod \"authorino-5d4b67c446-ks2jm\" (UID: \"bd411cdd-bc45-49ed-9c1f-17506b8979b7\") " pod="kuadrant-system/authorino-5d4b67c446-ks2jm"
Jul 09 17:17:40.702327 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.702300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n6nk\" (UniqueName: \"kubernetes.io/projected/bd411cdd-bc45-49ed-9c1f-17506b8979b7-kube-api-access-4n6nk\") pod \"authorino-5d4b67c446-ks2jm\" (UID: \"bd411cdd-bc45-49ed-9c1f-17506b8979b7\") " pod="kuadrant-system/authorino-5d4b67c446-ks2jm"
Jul 09 17:17:40.756583 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.756546    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks2jm"]
Jul 09 17:17:40.756786 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.756774    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ks2jm"
Jul 09 17:17:40.775619 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.775588    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59566655d9-zgjjp"]
Jul 09 17:17:40.778438 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.778404    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59566655d9-zgjjp"
Jul 09 17:17:40.786936 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.786912    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59566655d9-zgjjp"]
Jul 09 17:17:40.895437 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.895378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgrbz\" (UniqueName: \"kubernetes.io/projected/7c80a377-4244-4333-a2ea-72843aab8c41-kube-api-access-vgrbz\") pod \"authorino-59566655d9-zgjjp\" (UID: \"7c80a377-4244-4333-a2ea-72843aab8c41\") " pod="kuadrant-system/authorino-59566655d9-zgjjp"
Jul 09 17:17:40.903823 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.903659    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks2jm"]
Jul 09 17:17:40.906627 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:17:40.906590    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd411cdd_bc45_49ed_9c1f_17506b8979b7.slice/crio-b04fefb534f726312ade7cb40330ad63e9586b74512d20f225e120e64f73db53 WatchSource:0}: Error finding container b04fefb534f726312ade7cb40330ad63e9586b74512d20f225e120e64f73db53: Status 404 returned error can't find the container with id b04fefb534f726312ade7cb40330ad63e9586b74512d20f225e120e64f73db53
Jul 09 17:17:40.945470 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.945436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ks2jm" event={"ID":"bd411cdd-bc45-49ed-9c1f-17506b8979b7","Type":"ContainerStarted","Data":"b04fefb534f726312ade7cb40330ad63e9586b74512d20f225e120e64f73db53"}
Jul 09 17:17:40.996206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:40.996165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgrbz\" (UniqueName: \"kubernetes.io/projected/7c80a377-4244-4333-a2ea-72843aab8c41-kube-api-access-vgrbz\") pod \"authorino-59566655d9-zgjjp\" (UID: \"7c80a377-4244-4333-a2ea-72843aab8c41\") " pod="kuadrant-system/authorino-59566655d9-zgjjp"
Jul 09 17:17:41.004308 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.004277    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgrbz\" (UniqueName: \"kubernetes.io/projected/7c80a377-4244-4333-a2ea-72843aab8c41-kube-api-access-vgrbz\") pod \"authorino-59566655d9-zgjjp\" (UID: \"7c80a377-4244-4333-a2ea-72843aab8c41\") " pod="kuadrant-system/authorino-59566655d9-zgjjp"
Jul 09 17:17:41.089120 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.089035    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59566655d9-zgjjp"
Jul 09 17:17:41.227695 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.227637    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59566655d9-zgjjp"]
Jul 09 17:17:41.230514 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:17:41.230479    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c80a377_4244_4333_a2ea_72843aab8c41.slice/crio-5a77929d99093ea31c90662f10f74b8defdfd9b156b63118ed5c3ac9beaf39e2 WatchSource:0}: Error finding container 5a77929d99093ea31c90662f10f74b8defdfd9b156b63118ed5c3ac9beaf39e2: Status 404 returned error can't find the container with id 5a77929d99093ea31c90662f10f74b8defdfd9b156b63118ed5c3ac9beaf39e2
Jul 09 17:17:41.259044 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.259008    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:41.311059 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.310986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:41.951285 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.951252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ks2jm" event={"ID":"bd411cdd-bc45-49ed-9c1f-17506b8979b7","Type":"ContainerStarted","Data":"1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05"}
Jul 09 17:17:41.951510 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.951310    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ks2jm" podUID="bd411cdd-bc45-49ed-9c1f-17506b8979b7" containerName="authorino" containerID="cri-o://1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05" gracePeriod=30
Jul 09 17:17:41.952929 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.952903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59566655d9-zgjjp" event={"ID":"7c80a377-4244-4333-a2ea-72843aab8c41","Type":"ContainerStarted","Data":"66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e"}
Jul 09 17:17:41.953029 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.952941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59566655d9-zgjjp" event={"ID":"7c80a377-4244-4333-a2ea-72843aab8c41","Type":"ContainerStarted","Data":"5a77929d99093ea31c90662f10f74b8defdfd9b156b63118ed5c3ac9beaf39e2"}
Jul 09 17:17:41.966315 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.966269    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ks2jm" podStartSLOduration=1.547332355 podStartE2EDuration="1.966250199s" totalImagesPullingTime="418.917844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:17:41.9647503 +0000 UTC m=+531.671963247" watchObservedRunningTime="2026-07-09 17:17:41.966250199 +0000 UTC m=+531.673463144"
Jul 09 17:17:41.979849 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:41.979777    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59566655d9-zgjjp" podStartSLOduration=1.6856892380000001 podStartE2EDuration="1.979759394s" totalImagesPullingTime="294.070156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:17:41.978161634 +0000 UTC m=+531.685374581" watchObservedRunningTime="2026-07-09 17:17:41.979759394 +0000 UTC m=+531.686972366"
Jul 09 17:17:42.130893 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.130859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-645db8967c-tkqpd"]
Jul 09 17:17:42.133868 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.133843    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:17:42.136032 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.136011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 17:17:42.140197 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.140170    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-645db8967c-tkqpd"]
Jul 09 17:17:42.205181 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.205103    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnbr5\" (UniqueName: \"kubernetes.io/projected/57636027-56e4-4754-a443-66d8b62c06e2-kube-api-access-xnbr5\") pod \"authorino-645db8967c-tkqpd\" (UID: \"57636027-56e4-4754-a443-66d8b62c06e2\") " pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:17:42.205181 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.205163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57636027-56e4-4754-a443-66d8b62c06e2-tls-cert\") pod \"authorino-645db8967c-tkqpd\" (UID: \"57636027-56e4-4754-a443-66d8b62c06e2\") " pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:17:42.209277 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.209252    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ks2jm"
Jul 09 17:17:42.306431 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.306384    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n6nk\" (UniqueName: \"kubernetes.io/projected/bd411cdd-bc45-49ed-9c1f-17506b8979b7-kube-api-access-4n6nk\") pod \"bd411cdd-bc45-49ed-9c1f-17506b8979b7\" (UID: \"bd411cdd-bc45-49ed-9c1f-17506b8979b7\") "
Jul 09 17:17:42.306613 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.306507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57636027-56e4-4754-a443-66d8b62c06e2-tls-cert\") pod \"authorino-645db8967c-tkqpd\" (UID: \"57636027-56e4-4754-a443-66d8b62c06e2\") " pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:17:42.306613 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.306551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnbr5\" (UniqueName: \"kubernetes.io/projected/57636027-56e4-4754-a443-66d8b62c06e2-kube-api-access-xnbr5\") pod \"authorino-645db8967c-tkqpd\" (UID: \"57636027-56e4-4754-a443-66d8b62c06e2\") " pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:17:42.308729 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.308686    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd411cdd-bc45-49ed-9c1f-17506b8979b7-kube-api-access-4n6nk" (OuterVolumeSpecName: "kube-api-access-4n6nk") pod "bd411cdd-bc45-49ed-9c1f-17506b8979b7" (UID: "bd411cdd-bc45-49ed-9c1f-17506b8979b7"). InnerVolumeSpecName "kube-api-access-4n6nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:17:42.309027 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.309008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57636027-56e4-4754-a443-66d8b62c06e2-tls-cert\") pod \"authorino-645db8967c-tkqpd\" (UID: \"57636027-56e4-4754-a443-66d8b62c06e2\") " pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:17:42.314076 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.314056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnbr5\" (UniqueName: \"kubernetes.io/projected/57636027-56e4-4754-a443-66d8b62c06e2-kube-api-access-xnbr5\") pod \"authorino-645db8967c-tkqpd\" (UID: \"57636027-56e4-4754-a443-66d8b62c06e2\") " pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:17:42.407508 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.407461    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n6nk\" (UniqueName: \"kubernetes.io/projected/bd411cdd-bc45-49ed-9c1f-17506b8979b7-kube-api-access-4n6nk\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:17:42.446304 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.446271    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:17:42.586136 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.582472    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-645db8967c-tkqpd"]
Jul 09 17:17:42.604488 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:17:42.604442    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57636027_56e4_4754_a443_66d8b62c06e2.slice/crio-3164d9943c98273076cd265f5c85fcaebe537684095c21dbc43b102662e52ad9 WatchSource:0}: Error finding container 3164d9943c98273076cd265f5c85fcaebe537684095c21dbc43b102662e52ad9: Status 404 returned error can't find the container with id 3164d9943c98273076cd265f5c85fcaebe537684095c21dbc43b102662e52ad9
Jul 09 17:17:42.958773 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.958740    2579 generic.go:356] "Generic (PLEG): container finished" podID="bd411cdd-bc45-49ed-9c1f-17506b8979b7" containerID="1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05" exitCode=0
Jul 09 17:17:42.958965 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.958798    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ks2jm"
Jul 09 17:17:42.958965 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.958840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ks2jm" event={"ID":"bd411cdd-bc45-49ed-9c1f-17506b8979b7","Type":"ContainerDied","Data":"1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05"}
Jul 09 17:17:42.958965 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.958882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ks2jm" event={"ID":"bd411cdd-bc45-49ed-9c1f-17506b8979b7","Type":"ContainerDied","Data":"b04fefb534f726312ade7cb40330ad63e9586b74512d20f225e120e64f73db53"}
Jul 09 17:17:42.958965 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.958918    2579 scope.go:117] "RemoveContainer" containerID="1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05"
Jul 09 17:17:42.960237 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.960216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-645db8967c-tkqpd" event={"ID":"57636027-56e4-4754-a443-66d8b62c06e2","Type":"ContainerStarted","Data":"3164d9943c98273076cd265f5c85fcaebe537684095c21dbc43b102662e52ad9"}
Jul 09 17:17:42.967645 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.967624    2579 scope.go:117] "RemoveContainer" containerID="1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05"
Jul 09 17:17:42.967967 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:17:42.967944    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05\": container with ID starting with 1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05 not found: ID does not exist" containerID="1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05"
Jul 09 17:17:42.968021 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.967975    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05"} err="failed to get container status \"1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05\": rpc error: code = NotFound desc = could not find container \"1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05\": container with ID starting with 1ef945b2c893230e68145fdb821bd4db71efebefca352c60941e1f0e448dcf05 not found: ID does not exist"
Jul 09 17:17:42.974297 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.974266    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks2jm"]
Jul 09 17:17:42.976200 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:42.976175    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks2jm"]
Jul 09 17:17:43.965776 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:43.965740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-645db8967c-tkqpd" event={"ID":"57636027-56e4-4754-a443-66d8b62c06e2","Type":"ContainerStarted","Data":"d19b8a2571764a17c82ead8f9a75a20e5570e92dd9da40929766494b956bbe3b"}
Jul 09 17:17:43.981418 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:43.981360    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-645db8967c-tkqpd" podStartSLOduration=1.521645398 podStartE2EDuration="1.981342359s" totalImagesPullingTime="459.696961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:17:43.978960939 +0000 UTC m=+533.686173886" watchObservedRunningTime="2026-07-09 17:17:43.981342359 +0000 UTC m=+533.688555304"
Jul 09 17:17:44.006695 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.006658    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59566655d9-zgjjp"]
Jul 09 17:17:44.006914 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.006885    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59566655d9-zgjjp" podUID="7c80a377-4244-4333-a2ea-72843aab8c41" containerName="authorino" containerID="cri-o://66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e" gracePeriod=30
Jul 09 17:17:44.310308 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.310270    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59566655d9-zgjjp"
Jul 09 17:17:44.426860 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.426793    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgrbz\" (UniqueName: \"kubernetes.io/projected/7c80a377-4244-4333-a2ea-72843aab8c41-kube-api-access-vgrbz\") pod \"7c80a377-4244-4333-a2ea-72843aab8c41\" (UID: \"7c80a377-4244-4333-a2ea-72843aab8c41\") "
Jul 09 17:17:44.428952 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.428912    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c80a377-4244-4333-a2ea-72843aab8c41-kube-api-access-vgrbz" (OuterVolumeSpecName: "kube-api-access-vgrbz") pod "7c80a377-4244-4333-a2ea-72843aab8c41" (UID: "7c80a377-4244-4333-a2ea-72843aab8c41"). InnerVolumeSpecName "kube-api-access-vgrbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:17:44.528030 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.527944    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgrbz\" (UniqueName: \"kubernetes.io/projected/7c80a377-4244-4333-a2ea-72843aab8c41-kube-api-access-vgrbz\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:17:44.815186 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.815117    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd411cdd-bc45-49ed-9c1f-17506b8979b7" path="/var/lib/kubelet/pods/bd411cdd-bc45-49ed-9c1f-17506b8979b7/volumes"
Jul 09 17:17:44.972055 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.972020    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c80a377-4244-4333-a2ea-72843aab8c41" containerID="66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e" exitCode=0
Jul 09 17:17:44.972514 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.972069    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59566655d9-zgjjp"
Jul 09 17:17:44.972514 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.972099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59566655d9-zgjjp" event={"ID":"7c80a377-4244-4333-a2ea-72843aab8c41","Type":"ContainerDied","Data":"66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e"}
Jul 09 17:17:44.972514 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.972153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59566655d9-zgjjp" event={"ID":"7c80a377-4244-4333-a2ea-72843aab8c41","Type":"ContainerDied","Data":"5a77929d99093ea31c90662f10f74b8defdfd9b156b63118ed5c3ac9beaf39e2"}
Jul 09 17:17:44.972514 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.972178    2579 scope.go:117] "RemoveContainer" containerID="66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e"
Jul 09 17:17:44.980690 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.980673    2579 scope.go:117] "RemoveContainer" containerID="66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e"
Jul 09 17:17:44.981030 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:17:44.981004    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e\": container with ID starting with 66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e not found: ID does not exist" containerID="66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e"
Jul 09 17:17:44.981103 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.981037    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e"} err="failed to get container status \"66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e\": rpc error: code = NotFound desc = could not find container \"66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e\": container with ID starting with 66fc1d6bf482d71c4dd51333fd56a6de058a4ae3fe18e2bb971f1a454ff8421e not found: ID does not exist"
Jul 09 17:17:44.987941 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.987908    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59566655d9-zgjjp"]
Jul 09 17:17:44.989640 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:44.989616    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59566655d9-zgjjp"]
Jul 09 17:17:46.440443 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.440412    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8476c767-6kblc"]
Jul 09 17:17:46.440849 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.440739    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c80a377-4244-4333-a2ea-72843aab8c41" containerName="authorino"
Jul 09 17:17:46.440849 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.440750    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c80a377-4244-4333-a2ea-72843aab8c41" containerName="authorino"
Jul 09 17:17:46.440849 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.440772    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd411cdd-bc45-49ed-9c1f-17506b8979b7" containerName="authorino"
Jul 09 17:17:46.440849 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.440777    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd411cdd-bc45-49ed-9c1f-17506b8979b7" containerName="authorino"
Jul 09 17:17:46.440994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.440855    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c80a377-4244-4333-a2ea-72843aab8c41" containerName="authorino"
Jul 09 17:17:46.440994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.440866    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd411cdd-bc45-49ed-9c1f-17506b8979b7" containerName="authorino"
Jul 09 17:17:46.569561 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.569528    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8476c767-6kblc"]
Jul 09 17:17:46.569718 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.569635    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:46.571866 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.571846    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 17:17:46.571983 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.571847    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 17:17:46.571983 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.571852    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vxpl9\""
Jul 09 17:17:46.746953 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.746924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6358a51-e3b6-49e2-8457-99811b2df8e5-webhook-cert\") pod \"maas-controller-5b8476c767-6kblc\" (UID: \"c6358a51-e3b6-49e2-8457-99811b2df8e5\") " pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:46.747118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.746968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84xs5\" (UniqueName: \"kubernetes.io/projected/c6358a51-e3b6-49e2-8457-99811b2df8e5-kube-api-access-84xs5\") pod \"maas-controller-5b8476c767-6kblc\" (UID: \"c6358a51-e3b6-49e2-8457-99811b2df8e5\") " pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:46.815828 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.815782    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c80a377-4244-4333-a2ea-72843aab8c41" path="/var/lib/kubelet/pods/7c80a377-4244-4333-a2ea-72843aab8c41/volumes"
Jul 09 17:17:46.848270 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.848233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84xs5\" (UniqueName: \"kubernetes.io/projected/c6358a51-e3b6-49e2-8457-99811b2df8e5-kube-api-access-84xs5\") pod \"maas-controller-5b8476c767-6kblc\" (UID: \"c6358a51-e3b6-49e2-8457-99811b2df8e5\") " pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:46.848393 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.848379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6358a51-e3b6-49e2-8457-99811b2df8e5-webhook-cert\") pod \"maas-controller-5b8476c767-6kblc\" (UID: \"c6358a51-e3b6-49e2-8457-99811b2df8e5\") " pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:46.850897 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.850869    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6358a51-e3b6-49e2-8457-99811b2df8e5-webhook-cert\") pod \"maas-controller-5b8476c767-6kblc\" (UID: \"c6358a51-e3b6-49e2-8457-99811b2df8e5\") " pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:46.856845 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.856799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84xs5\" (UniqueName: \"kubernetes.io/projected/c6358a51-e3b6-49e2-8457-99811b2df8e5-kube-api-access-84xs5\") pod \"maas-controller-5b8476c767-6kblc\" (UID: \"c6358a51-e3b6-49e2-8457-99811b2df8e5\") " pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:46.880371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:46.880338    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:47.034533 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:47.034506    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8476c767-6kblc"]
Jul 09 17:17:47.036775 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:17:47.036743    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6358a51_e3b6_49e2_8457_99811b2df8e5.slice/crio-bfda677a4dc0050ae56cad578f88bb0a0ca43ab1e0e04247e1722013c3172be3 WatchSource:0}: Error finding container bfda677a4dc0050ae56cad578f88bb0a0ca43ab1e0e04247e1722013c3172be3: Status 404 returned error can't find the container with id bfda677a4dc0050ae56cad578f88bb0a0ca43ab1e0e04247e1722013c3172be3
Jul 09 17:17:47.566641 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:47.566586    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:47.662365 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:47.662327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:47.990615 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:47.990528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8476c767-6kblc" event={"ID":"c6358a51-e3b6-49e2-8457-99811b2df8e5","Type":"ContainerStarted","Data":"bfda677a4dc0050ae56cad578f88bb0a0ca43ab1e0e04247e1722013c3172be3"}
Jul 09 17:17:49.476185 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:49.476136    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:49.567532 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:49.567457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:50.003460 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:50.003418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8476c767-6kblc" event={"ID":"c6358a51-e3b6-49e2-8457-99811b2df8e5","Type":"ContainerStarted","Data":"f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3"}
Jul 09 17:17:50.003649 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:50.003488    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:17:50.022992 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:50.022524    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8476c767-6kblc" podStartSLOduration=1.4983681770000001 podStartE2EDuration="4.022501085s" totalImagesPullingTime="2.524132908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:17:50.02128787 +0000 UTC m=+539.728500834" watchObservedRunningTime="2026-07-09 17:17:50.022501085 +0000 UTC m=+539.729714033"
Jul 09 17:17:51.685413 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:51.685350    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:17:51.785899 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:17:51.785861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:01.014052 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.014020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:18:01.399531 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.399440    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8476c767-6kblc"]
Jul 09 17:18:01.399710 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.399658    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b8476c767-6kblc" podUID="c6358a51-e3b6-49e2-8457-99811b2df8e5" containerName="manager" containerID="cri-o://f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3" gracePeriod=30
Jul 09 17:18:01.646296 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.646267    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:18:01.667691 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.667600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84xs5\" (UniqueName: \"kubernetes.io/projected/c6358a51-e3b6-49e2-8457-99811b2df8e5-kube-api-access-84xs5\") pod \"c6358a51-e3b6-49e2-8457-99811b2df8e5\" (UID: \"c6358a51-e3b6-49e2-8457-99811b2df8e5\") "
Jul 09 17:18:01.667877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.667698    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6358a51-e3b6-49e2-8457-99811b2df8e5-webhook-cert\") pod \"c6358a51-e3b6-49e2-8457-99811b2df8e5\" (UID: \"c6358a51-e3b6-49e2-8457-99811b2df8e5\") "
Jul 09 17:18:01.670058 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.670025    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6358a51-e3b6-49e2-8457-99811b2df8e5-kube-api-access-84xs5" (OuterVolumeSpecName: "kube-api-access-84xs5") pod "c6358a51-e3b6-49e2-8457-99811b2df8e5" (UID: "c6358a51-e3b6-49e2-8457-99811b2df8e5"). InnerVolumeSpecName "kube-api-access-84xs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:18:01.670189 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.670121    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6358a51-e3b6-49e2-8457-99811b2df8e5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c6358a51-e3b6-49e2-8457-99811b2df8e5" (UID: "c6358a51-e3b6-49e2-8457-99811b2df8e5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:18:01.768626 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.768585    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84xs5\" (UniqueName: \"kubernetes.io/projected/c6358a51-e3b6-49e2-8457-99811b2df8e5-kube-api-access-84xs5\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:18:01.768626 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:01.768621    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6358a51-e3b6-49e2-8457-99811b2df8e5-webhook-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:18:02.055844 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.055780    2579 generic.go:356] "Generic (PLEG): container finished" podID="c6358a51-e3b6-49e2-8457-99811b2df8e5" containerID="f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3" exitCode=0
Jul 09 17:18:02.056326 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.055860    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8476c767-6kblc"
Jul 09 17:18:02.056326 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.055859    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8476c767-6kblc" event={"ID":"c6358a51-e3b6-49e2-8457-99811b2df8e5","Type":"ContainerDied","Data":"f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3"}
Jul 09 17:18:02.056326 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.055931    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8476c767-6kblc" event={"ID":"c6358a51-e3b6-49e2-8457-99811b2df8e5","Type":"ContainerDied","Data":"bfda677a4dc0050ae56cad578f88bb0a0ca43ab1e0e04247e1722013c3172be3"}
Jul 09 17:18:02.056326 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.055966    2579 scope.go:117] "RemoveContainer" containerID="f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3"
Jul 09 17:18:02.065728 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.065695    2579 scope.go:117] "RemoveContainer" containerID="f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3"
Jul 09 17:18:02.066114 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:18:02.066093    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3\": container with ID starting with f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3 not found: ID does not exist" containerID="f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3"
Jul 09 17:18:02.066223 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.066122    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3"} err="failed to get container status \"f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3\": rpc error: code = NotFound desc = could not find container \"f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3\": container with ID starting with f1214fa26e15b1c5b6949486d143ff9ba6ad60c483497fbabb0904697c2e0ef3 not found: ID does not exist"
Jul 09 17:18:02.078700 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.078663    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8476c767-6kblc"]
Jul 09 17:18:02.085093 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.085060    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b8476c767-6kblc"]
Jul 09 17:18:02.815509 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:02.815473    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6358a51-e3b6-49e2-8457-99811b2df8e5" path="/var/lib/kubelet/pods/c6358a51-e3b6-49e2-8457-99811b2df8e5/volumes"
Jul 09 17:18:20.812984 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:20.812941    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:20.912222 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:20.912187    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:21.012855 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:21.012803    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:21.373647 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:21.373619    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:21.527981 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:21.527947    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:21.956304 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:21.956274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:22.058166 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.058134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:22.132251 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.132213    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-stbzf"]
Jul 09 17:18:22.132777 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.132759    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6358a51-e3b6-49e2-8457-99811b2df8e5" containerName="manager"
Jul 09 17:18:22.132846 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.132781    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6358a51-e3b6-49e2-8457-99811b2df8e5" containerName="manager"
Jul 09 17:18:22.132900 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.132887    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6358a51-e3b6-49e2-8457-99811b2df8e5" containerName="manager"
Jul 09 17:18:22.140037 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.140011    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:22.144935 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.144904    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 17:18:22.145133 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.144956    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vg8r8\""
Jul 09 17:18:22.151498 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.151467    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-stbzf"]
Jul 09 17:18:22.230969 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.230867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7943560a-f856-4fd8-be9e-4acbd03e6c39-plugins-config-volume\") pod \"payload-pre-processing-7964457696-stbzf\" (UID: \"7943560a-f856-4fd8-be9e-4acbd03e6c39\") " pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:22.230969 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.230908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzq54\" (UniqueName: \"kubernetes.io/projected/7943560a-f856-4fd8-be9e-4acbd03e6c39-kube-api-access-bzq54\") pod \"payload-pre-processing-7964457696-stbzf\" (UID: \"7943560a-f856-4fd8-be9e-4acbd03e6c39\") " pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:22.331860 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.331791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7943560a-f856-4fd8-be9e-4acbd03e6c39-plugins-config-volume\") pod \"payload-pre-processing-7964457696-stbzf\" (UID: \"7943560a-f856-4fd8-be9e-4acbd03e6c39\") " pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:22.331860 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.331868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzq54\" (UniqueName: \"kubernetes.io/projected/7943560a-f856-4fd8-be9e-4acbd03e6c39-kube-api-access-bzq54\") pod \"payload-pre-processing-7964457696-stbzf\" (UID: \"7943560a-f856-4fd8-be9e-4acbd03e6c39\") " pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:22.332548 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.332527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7943560a-f856-4fd8-be9e-4acbd03e6c39-plugins-config-volume\") pod \"payload-pre-processing-7964457696-stbzf\" (UID: \"7943560a-f856-4fd8-be9e-4acbd03e6c39\") " pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:22.346970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.346930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzq54\" (UniqueName: \"kubernetes.io/projected/7943560a-f856-4fd8-be9e-4acbd03e6c39-kube-api-access-bzq54\") pod \"payload-pre-processing-7964457696-stbzf\" (UID: \"7943560a-f856-4fd8-be9e-4acbd03e6c39\") " pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:22.453074 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.453040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:22.596407 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:22.596378    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-stbzf"]
Jul 09 17:18:22.598774 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:18:22.598742    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7943560a_f856_4fd8_be9e_4acbd03e6c39.slice/crio-f1dfe16eca6eb8a595cb781380e0bcb803f07bf0bf10f6e3bdae40db5f8b520f WatchSource:0}: Error finding container f1dfe16eca6eb8a595cb781380e0bcb803f07bf0bf10f6e3bdae40db5f8b520f: Status 404 returned error can't find the container with id f1dfe16eca6eb8a595cb781380e0bcb803f07bf0bf10f6e3bdae40db5f8b520f
Jul 09 17:18:23.147691 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:23.147652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-stbzf" event={"ID":"7943560a-f856-4fd8-be9e-4acbd03e6c39","Type":"ContainerStarted","Data":"f1dfe16eca6eb8a595cb781380e0bcb803f07bf0bf10f6e3bdae40db5f8b520f"}
Jul 09 17:18:25.158007 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:25.157969    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-stbzf" event={"ID":"7943560a-f856-4fd8-be9e-4acbd03e6c39","Type":"ContainerStarted","Data":"94a7c71b7f0d2f15cac0c4b037edbb404f0e65e4958b483d99926a6a3b8fea42"}
Jul 09 17:18:25.158406 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:25.158039    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:25.174202 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:25.174152    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-stbzf" podStartSLOduration=1.6506618469999998 podStartE2EDuration="3.17413024s" totalImagesPullingTime="1.523468393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:18:25.172258986 +0000 UTC m=+574.879471934" watchObservedRunningTime="2026-07-09 17:18:25.17413024 +0000 UTC m=+574.881343187"
Jul 09 17:18:33.575854 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:33.575764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:33.676047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:33.676017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:36.165272 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:36.165242    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-stbzf"
Jul 09 17:18:52.668438 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.668395    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"]
Jul 09 17:18:52.673255 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.673227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.676828 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.676776    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 17:18:52.676828 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.676828    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 17:18:52.677070 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.676835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 17:18:52.677070 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.676776    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q9m66\""
Jul 09 17:18:52.683557 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.683528    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"]
Jul 09 17:18:52.718172 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.718140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:18:52.787388 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.787344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.787388 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.787392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.787636 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.787428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.787636 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.787450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.787636 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.787558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.787636 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.787598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd456\" (UniqueName: \"kubernetes.io/projected/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-kube-api-access-cd456\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889002 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.888956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889198 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.889007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889198 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.889131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889198 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.889176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889362 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.889247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889362 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.889291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd456\" (UniqueName: \"kubernetes.io/projected/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-kube-api-access-cd456\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889461 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.889419    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889579 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.889546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.889701 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.889683    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.891505 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.891480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.891877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.891857    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.896918 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.896886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd456\" (UniqueName: \"kubernetes.io/projected/0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9-kube-api-access-cd456\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw\" (UID: \"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:52.986755 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:52.986655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:18:53.129582 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:53.129555    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"]
Jul 09 17:18:53.131889 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:18:53.131861    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbdf26c_55e1_4b3d_9e0c_5d97e5e13aa9.slice/crio-8a019432faa320b1572d6aaaf3bdbf37e572bebf83ab45a6638c0bdcc11eb663 WatchSource:0}: Error finding container 8a019432faa320b1572d6aaaf3bdbf37e572bebf83ab45a6638c0bdcc11eb663: Status 404 returned error can't find the container with id 8a019432faa320b1572d6aaaf3bdbf37e572bebf83ab45a6638c0bdcc11eb663
Jul 09 17:18:53.281231 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:53.281196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw" event={"ID":"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9","Type":"ContainerStarted","Data":"8a019432faa320b1572d6aaaf3bdbf37e572bebf83ab45a6638c0bdcc11eb663"}
Jul 09 17:18:55.293068 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:55.293027    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw" event={"ID":"0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9","Type":"ContainerStarted","Data":"6f1c196cc43f13cbfa48322067d2185d7f91aebda0e2d4c394f024c6bb192537"}
Jul 09 17:18:55.312138 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:55.312068    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw" podStartSLOduration=1.894977147 podStartE2EDuration="3.312050824s" totalImagesPullingTime="1.417073677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:18:55.311742647 +0000 UTC m=+605.018955594" watchObservedRunningTime="2026-07-09 17:18:55.312050824 +0000 UTC m=+605.019263769"
Jul 09 17:18:57.411146 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:18:57.411111    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:19:02.987363 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:02.987319    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:19:02.989991 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:02.987409    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:19:03.000169 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:03.000142    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:19:03.337674 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:03.337644    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw"
Jul 09 17:19:04.783750 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.783710    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"]
Jul 09 17:19:04.787858 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.787831    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.791016 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.790993    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 17:19:04.795908 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.795882    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"]
Jul 09 17:19:04.812893 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.812856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:19:04.883514 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.883475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86bz\" (UniqueName: \"kubernetes.io/projected/2e819617-372b-4b44-a31a-3ca9051c59d5-kube-api-access-c86bz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.883696 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.883547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.883696 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.883637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.883696 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.883682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e819617-372b-4b44-a31a-3ca9051c59d5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.883917 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.883724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.883917 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.883778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.984548 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.984499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.984548 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.984559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.984761 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.984672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e819617-372b-4b44-a31a-3ca9051c59d5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.984761 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.984723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.984900 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.984765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.984900 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.984791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86bz\" (UniqueName: \"kubernetes.io/projected/2e819617-372b-4b44-a31a-3ca9051c59d5-kube-api-access-c86bz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.985015 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.984906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.985015 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.984972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.985196 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.985176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.987018 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.986998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e819617-372b-4b44-a31a-3ca9051c59d5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.987205 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.987187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e819617-372b-4b44-a31a-3ca9051c59d5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:04.992802 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:04.992774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86bz\" (UniqueName: \"kubernetes.io/projected/2e819617-372b-4b44-a31a-3ca9051c59d5-kube-api-access-c86bz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-58wtf\" (UID: \"2e819617-372b-4b44-a31a-3ca9051c59d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:05.098691 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:05.098599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:05.235805 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:05.235778    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"]
Jul 09 17:19:05.238645 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:19:05.238613    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e819617_372b_4b44_a31a_3ca9051c59d5.slice/crio-a0cc8e8cae5e4f0cff2004d4bc8cb65d35a88510d45964be2d51f7859b001bea WatchSource:0}: Error finding container a0cc8e8cae5e4f0cff2004d4bc8cb65d35a88510d45964be2d51f7859b001bea: Status 404 returned error can't find the container with id a0cc8e8cae5e4f0cff2004d4bc8cb65d35a88510d45964be2d51f7859b001bea
Jul 09 17:19:05.240414 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:05.240397    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:19:05.335511 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:05.335474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf" event={"ID":"2e819617-372b-4b44-a31a-3ca9051c59d5","Type":"ContainerStarted","Data":"a0cc8e8cae5e4f0cff2004d4bc8cb65d35a88510d45964be2d51f7859b001bea"}
Jul 09 17:19:06.342725 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:06.342689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf" event={"ID":"2e819617-372b-4b44-a31a-3ca9051c59d5","Type":"ContainerStarted","Data":"b1ec74a339e89b7d28dbdfd6d92bb5752936f49f507f7f377fafebd4cd898768"}
Jul 09 17:19:06.361704 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:06.361629    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf" podStartSLOduration=1.99588965 podStartE2EDuration="2.361607764s" totalImagesPullingTime="365.718114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:19:06.36034008 +0000 UTC m=+616.067553054" watchObservedRunningTime="2026-07-09 17:19:06.361607764 +0000 UTC m=+616.068820711"
Jul 09 17:19:09.526429 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:09.526393    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:19:15.099277 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:15.099191    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:15.099277 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:15.099264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:15.111896 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:15.111868    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:15.395682 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:15.395604    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-58wtf"
Jul 09 17:19:19.776676 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.776636    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"]
Jul 09 17:19:19.780251 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.780223    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.782700 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.782676    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 17:19:19.790905 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.790875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"]
Jul 09 17:19:19.819735 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.819700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.819960 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.819742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.819960 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.819767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.819960 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.819912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.820132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.820014    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m95jk\" (UniqueName: \"kubernetes.io/projected/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-kube-api-access-m95jk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.820132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.820059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.890358 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.890328    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:19:19.920570 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.920529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.920770 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.920588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.920770 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.920670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m95jk\" (UniqueName: \"kubernetes.io/projected/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-kube-api-access-m95jk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.920770 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.920699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.920770 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.920740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.921026 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.920782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.921026 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.921011    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.921453 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.921428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.921800 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.921781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.923436 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.923410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.924218 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.924193    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:19.929627 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:19.929595    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m95jk\" (UniqueName: \"kubernetes.io/projected/f81ed3f5-612e-4b33-a74b-e4350c0ed1c5-kube-api-access-m95jk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vxv6k\" (UID: \"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:20.091528 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:20.091437    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:20.232319 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:20.232290    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"]
Jul 09 17:19:20.235050 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:19:20.235023    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81ed3f5_612e_4b33_a74b_e4350c0ed1c5.slice/crio-df6e64ed2e356c4bfbcdac2d7aa2a8df31d2523cb7b0397dbace68bc8dabcaeb WatchSource:0}: Error finding container df6e64ed2e356c4bfbcdac2d7aa2a8df31d2523cb7b0397dbace68bc8dabcaeb: Status 404 returned error can't find the container with id df6e64ed2e356c4bfbcdac2d7aa2a8df31d2523cb7b0397dbace68bc8dabcaeb
Jul 09 17:19:20.408384 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:20.408288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k" event={"ID":"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5","Type":"ContainerStarted","Data":"df6e64ed2e356c4bfbcdac2d7aa2a8df31d2523cb7b0397dbace68bc8dabcaeb"}
Jul 09 17:19:21.415395 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:21.415360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k" event={"ID":"f81ed3f5-612e-4b33-a74b-e4350c0ed1c5","Type":"ContainerStarted","Data":"bff505a35edff82357bf5552508f28b3b1ad5a52ddf1558e80eed16ef4ede660"}
Jul 09 17:19:21.434361 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:21.434294    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k" podStartSLOduration=2.222239836 podStartE2EDuration="2.434270193s" totalImagesPullingTime="212.030357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:19:21.432896667 +0000 UTC m=+631.140109635" watchObservedRunningTime="2026-07-09 17:19:21.434270193 +0000 UTC m=+631.141483140"
Jul 09 17:19:25.203917 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:25.203884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:19:30.091921 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:30.091874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:30.092504 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:30.091952    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:30.105790 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:30.105758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:19:30.470338 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:19:30.470253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vxv6k"
Jul 09 17:20:07.801652 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:07.801620    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:20:07.862525 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:07.862492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:20:15.753629 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:15.753595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:20:31.572118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.572082    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-645db8967c-tkqpd"]
Jul 09 17:20:31.572662 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.572255    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-645db8967c-tkqpd" podUID="57636027-56e4-4754-a443-66d8b62c06e2" containerName="authorino" containerID="cri-o://d19b8a2571764a17c82ead8f9a75a20e5570e92dd9da40929766494b956bbe3b" gracePeriod=30
Jul 09 17:20:31.741290 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.741255    2579 generic.go:356] "Generic (PLEG): container finished" podID="57636027-56e4-4754-a443-66d8b62c06e2" containerID="d19b8a2571764a17c82ead8f9a75a20e5570e92dd9da40929766494b956bbe3b" exitCode=0
Jul 09 17:20:31.741461 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.741329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-645db8967c-tkqpd" event={"ID":"57636027-56e4-4754-a443-66d8b62c06e2","Type":"ContainerDied","Data":"d19b8a2571764a17c82ead8f9a75a20e5570e92dd9da40929766494b956bbe3b"}
Jul 09 17:20:31.833123 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.833053    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:20:31.955695 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.955660    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnbr5\" (UniqueName: \"kubernetes.io/projected/57636027-56e4-4754-a443-66d8b62c06e2-kube-api-access-xnbr5\") pod \"57636027-56e4-4754-a443-66d8b62c06e2\" (UID: \"57636027-56e4-4754-a443-66d8b62c06e2\") "
Jul 09 17:20:31.955917 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.955712    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57636027-56e4-4754-a443-66d8b62c06e2-tls-cert\") pod \"57636027-56e4-4754-a443-66d8b62c06e2\" (UID: \"57636027-56e4-4754-a443-66d8b62c06e2\") "
Jul 09 17:20:31.957891 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.957859    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57636027-56e4-4754-a443-66d8b62c06e2-kube-api-access-xnbr5" (OuterVolumeSpecName: "kube-api-access-xnbr5") pod "57636027-56e4-4754-a443-66d8b62c06e2" (UID: "57636027-56e4-4754-a443-66d8b62c06e2"). InnerVolumeSpecName "kube-api-access-xnbr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:20:31.966501 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:31.966468    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57636027-56e4-4754-a443-66d8b62c06e2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "57636027-56e4-4754-a443-66d8b62c06e2" (UID: "57636027-56e4-4754-a443-66d8b62c06e2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:20:32.056424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.056384    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnbr5\" (UniqueName: \"kubernetes.io/projected/57636027-56e4-4754-a443-66d8b62c06e2-kube-api-access-xnbr5\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:20:32.056424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.056417    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57636027-56e4-4754-a443-66d8b62c06e2-tls-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:20:32.150745 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.150657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:20:32.251153 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.251126    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:20:32.747027 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.746995    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-645db8967c-tkqpd"
Jul 09 17:20:32.747416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.747034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-645db8967c-tkqpd" event={"ID":"57636027-56e4-4754-a443-66d8b62c06e2","Type":"ContainerDied","Data":"3164d9943c98273076cd265f5c85fcaebe537684095c21dbc43b102662e52ad9"}
Jul 09 17:20:32.747416 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.747085    2579 scope.go:117] "RemoveContainer" containerID="d19b8a2571764a17c82ead8f9a75a20e5570e92dd9da40929766494b956bbe3b"
Jul 09 17:20:32.771611 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.771575    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-645db8967c-tkqpd"]
Jul 09 17:20:32.777975 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.777946    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-645db8967c-tkqpd"]
Jul 09 17:20:32.815556 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:32.815523    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57636027-56e4-4754-a443-66d8b62c06e2" path="/var/lib/kubelet/pods/57636027-56e4-4754-a443-66d8b62c06e2/volumes"
Jul 09 17:20:33.287716 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:33.287677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:20:33.385661 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:20:33.385626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:21:19.478793 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:19.478754    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:21:43.957663 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:43.957619    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:21:45.265567 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.265526    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:21:45.384555 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.384524    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79dbcf8674-6blp8"]
Jul 09 17:21:45.384892 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.384880    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57636027-56e4-4754-a443-66d8b62c06e2" containerName="authorino"
Jul 09 17:21:45.384892 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.384894    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57636027-56e4-4754-a443-66d8b62c06e2" containerName="authorino"
Jul 09 17:21:45.385010 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.384956    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57636027-56e4-4754-a443-66d8b62c06e2" containerName="authorino"
Jul 09 17:21:45.387023 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.387004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:45.390273 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.390253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 17:21:45.390373 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.390253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vxpl9\""
Jul 09 17:21:45.390373 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.390253    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 17:21:45.398669 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.398646    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79dbcf8674-6blp8"]
Jul 09 17:21:45.484778 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.484732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd8mw\" (UniqueName: \"kubernetes.io/projected/34783aaa-fc9e-45fa-b917-dd1cd84a9f63-kube-api-access-cd8mw\") pod \"maas-controller-79dbcf8674-6blp8\" (UID: \"34783aaa-fc9e-45fa-b917-dd1cd84a9f63\") " pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:45.484989 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.484797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34783aaa-fc9e-45fa-b917-dd1cd84a9f63-webhook-cert\") pod \"maas-controller-79dbcf8674-6blp8\" (UID: \"34783aaa-fc9e-45fa-b917-dd1cd84a9f63\") " pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:45.585578 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.585483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd8mw\" (UniqueName: \"kubernetes.io/projected/34783aaa-fc9e-45fa-b917-dd1cd84a9f63-kube-api-access-cd8mw\") pod \"maas-controller-79dbcf8674-6blp8\" (UID: \"34783aaa-fc9e-45fa-b917-dd1cd84a9f63\") " pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:45.585578 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.585576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34783aaa-fc9e-45fa-b917-dd1cd84a9f63-webhook-cert\") pod \"maas-controller-79dbcf8674-6blp8\" (UID: \"34783aaa-fc9e-45fa-b917-dd1cd84a9f63\") " pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:45.588115 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.588095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34783aaa-fc9e-45fa-b917-dd1cd84a9f63-webhook-cert\") pod \"maas-controller-79dbcf8674-6blp8\" (UID: \"34783aaa-fc9e-45fa-b917-dd1cd84a9f63\") " pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:45.594396 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.594364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd8mw\" (UniqueName: \"kubernetes.io/projected/34783aaa-fc9e-45fa-b917-dd1cd84a9f63-kube-api-access-cd8mw\") pod \"maas-controller-79dbcf8674-6blp8\" (UID: \"34783aaa-fc9e-45fa-b917-dd1cd84a9f63\") " pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:45.698235 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.698188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:45.848632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:45.848603    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79dbcf8674-6blp8"]
Jul 09 17:21:45.851181 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:21:45.851153    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34783aaa_fc9e_45fa_b917_dd1cd84a9f63.slice/crio-a1d91cd77f85b192804e6da787f7df56fbf5d8628c240f42a09d9b3d95dab59d WatchSource:0}: Error finding container a1d91cd77f85b192804e6da787f7df56fbf5d8628c240f42a09d9b3d95dab59d: Status 404 returned error can't find the container with id a1d91cd77f85b192804e6da787f7df56fbf5d8628c240f42a09d9b3d95dab59d
Jul 09 17:21:46.078088 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:46.078032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79dbcf8674-6blp8" event={"ID":"34783aaa-fc9e-45fa-b917-dd1cd84a9f63","Type":"ContainerStarted","Data":"a1d91cd77f85b192804e6da787f7df56fbf5d8628c240f42a09d9b3d95dab59d"}
Jul 09 17:21:47.084353 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:47.084316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79dbcf8674-6blp8" event={"ID":"34783aaa-fc9e-45fa-b917-dd1cd84a9f63","Type":"ContainerStarted","Data":"f66ed9b1489c882896a9d72e259e252742948da3c21de2c2b4a879c62ba44724"}
Jul 09 17:21:47.084759 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:47.084409    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:21:47.107511 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:47.107455    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79dbcf8674-6blp8" podStartSLOduration=1.644271944 podStartE2EDuration="2.107438659s" totalImagesPullingTime="463.166715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:21:47.104561663 +0000 UTC m=+776.811774620" watchObservedRunningTime="2026-07-09 17:21:47.107438659 +0000 UTC m=+776.814651605"
Jul 09 17:21:58.094936 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:21:58.094898    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79dbcf8674-6blp8"
Jul 09 17:22:00.089663 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:00.089626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:24.914057 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:24.914024    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:25.011353 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:25.011314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:25.129650 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:25.129615    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:30.962783 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:30.962735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:31.118460 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:31.118424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:31.229612 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:31.229514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:31.330249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:31.330212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:37.165388 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:37.165352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:37.540206 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:37.540173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:51.166427 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:51.166390    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:22:54.575437 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:22:54.575396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:26:34.573933 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:34.573896    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"]
Jul 09 17:26:34.576279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:34.574131    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9" podUID="19673264-8b8d-428e-85b9-ecec5f2cd156" containerName="manager" containerID="cri-o://8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62" gracePeriod=10
Jul 09 17:26:38.618735 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:38.618709    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:26:38.720630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:38.720522    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd69l\" (UniqueName: \"kubernetes.io/projected/19673264-8b8d-428e-85b9-ecec5f2cd156-kube-api-access-gd69l\") pod \"19673264-8b8d-428e-85b9-ecec5f2cd156\" (UID: \"19673264-8b8d-428e-85b9-ecec5f2cd156\") "
Jul 09 17:26:38.720630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:38.720582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19673264-8b8d-428e-85b9-ecec5f2cd156-extensions-socket-volume\") pod \"19673264-8b8d-428e-85b9-ecec5f2cd156\" (UID: \"19673264-8b8d-428e-85b9-ecec5f2cd156\") "
Jul 09 17:26:38.721035 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:38.721006    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19673264-8b8d-428e-85b9-ecec5f2cd156-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "19673264-8b8d-428e-85b9-ecec5f2cd156" (UID: "19673264-8b8d-428e-85b9-ecec5f2cd156"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:26:38.722651 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:38.722626    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19673264-8b8d-428e-85b9-ecec5f2cd156-kube-api-access-gd69l" (OuterVolumeSpecName: "kube-api-access-gd69l") pod "19673264-8b8d-428e-85b9-ecec5f2cd156" (UID: "19673264-8b8d-428e-85b9-ecec5f2cd156"). InnerVolumeSpecName "kube-api-access-gd69l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:26:38.821977 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:38.821943    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd69l\" (UniqueName: \"kubernetes.io/projected/19673264-8b8d-428e-85b9-ecec5f2cd156-kube-api-access-gd69l\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:26:38.821977 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:38.821969    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19673264-8b8d-428e-85b9-ecec5f2cd156-extensions-socket-volume\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:26:39.443731 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.443695    2579 generic.go:356] "Generic (PLEG): container finished" podID="19673264-8b8d-428e-85b9-ecec5f2cd156" containerID="8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62" exitCode=0
Jul 09 17:26:39.443934 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.443740    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"
Jul 09 17:26:39.443934 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.443776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9" event={"ID":"19673264-8b8d-428e-85b9-ecec5f2cd156","Type":"ContainerDied","Data":"8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62"}
Jul 09 17:26:39.443934 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.443852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9" event={"ID":"19673264-8b8d-428e-85b9-ecec5f2cd156","Type":"ContainerDied","Data":"e6d6d917d1d18481b3e7fc6a31369d522410351dec1c8f33efce4595a7bbd234"}
Jul 09 17:26:39.443934 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.443876    2579 scope.go:117] "RemoveContainer" containerID="8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62"
Jul 09 17:26:39.452994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.452973    2579 scope.go:117] "RemoveContainer" containerID="8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62"
Jul 09 17:26:39.453304 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:26:39.453281    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62\": container with ID starting with 8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62 not found: ID does not exist" containerID="8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62"
Jul 09 17:26:39.453351 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.453313    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62"} err="failed to get container status \"8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62\": rpc error: code = NotFound desc = could not find container \"8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62\": container with ID starting with 8cad8e5b5837055155341621e85559999e18986f31428994f1c00634abd3fa62 not found: ID does not exist"
Jul 09 17:26:39.459725 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.459696    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"]
Jul 09 17:26:39.462458 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:39.462436    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7ct9"]
Jul 09 17:26:40.814771 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:26:40.814736    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19673264-8b8d-428e-85b9-ecec5f2cd156" path="/var/lib/kubelet/pods/19673264-8b8d-428e-85b9-ecec5f2cd156/volumes"
Jul 09 17:27:08.062044 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:08.062011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:27:35.773370 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.773334    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"]
Jul 09 17:27:35.773911 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.773781    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19673264-8b8d-428e-85b9-ecec5f2cd156" containerName="manager"
Jul 09 17:27:35.773911 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.773797    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="19673264-8b8d-428e-85b9-ecec5f2cd156" containerName="manager"
Jul 09 17:27:35.773911 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.773891    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="19673264-8b8d-428e-85b9-ecec5f2cd156" containerName="manager"
Jul 09 17:27:35.776830 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.776785    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:35.779444 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.779421    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-srbrf\""
Jul 09 17:27:35.790569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.790537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"]
Jul 09 17:27:35.807070 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.807030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25952548-141a-4803-954b-2798bff9426f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mftxx\" (UID: \"25952548-141a-4803-954b-2798bff9426f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:35.807260 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.807094    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p84v\" (UniqueName: \"kubernetes.io/projected/25952548-141a-4803-954b-2798bff9426f-kube-api-access-4p84v\") pod \"kuadrant-operator-controller-manager-86878c769f-mftxx\" (UID: \"25952548-141a-4803-954b-2798bff9426f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:35.907870 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.907804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p84v\" (UniqueName: \"kubernetes.io/projected/25952548-141a-4803-954b-2798bff9426f-kube-api-access-4p84v\") pod \"kuadrant-operator-controller-manager-86878c769f-mftxx\" (UID: \"25952548-141a-4803-954b-2798bff9426f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:35.908058 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.907953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25952548-141a-4803-954b-2798bff9426f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mftxx\" (UID: \"25952548-141a-4803-954b-2798bff9426f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:35.908361 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.908342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25952548-141a-4803-954b-2798bff9426f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mftxx\" (UID: \"25952548-141a-4803-954b-2798bff9426f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:35.917257 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:35.917229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p84v\" (UniqueName: \"kubernetes.io/projected/25952548-141a-4803-954b-2798bff9426f-kube-api-access-4p84v\") pod \"kuadrant-operator-controller-manager-86878c769f-mftxx\" (UID: \"25952548-141a-4803-954b-2798bff9426f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:36.088661 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:36.088555    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:36.237141 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:36.237108    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"]
Jul 09 17:27:36.238379 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:27:36.238352    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25952548_141a_4803_954b_2798bff9426f.slice/crio-511ab70c0f73049381470473c4edb909b06053d72d60182be14f839baa936f6d WatchSource:0}: Error finding container 511ab70c0f73049381470473c4edb909b06053d72d60182be14f839baa936f6d: Status 404 returned error can't find the container with id 511ab70c0f73049381470473c4edb909b06053d72d60182be14f839baa936f6d
Jul 09 17:27:36.711573 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:36.711539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx" event={"ID":"25952548-141a-4803-954b-2798bff9426f","Type":"ContainerStarted","Data":"ce454df5583fbf18de331f89a01013d70b815e1f71423977f69e2c671cb28e46"}
Jul 09 17:27:36.711748 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:36.711592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx" event={"ID":"25952548-141a-4803-954b-2798bff9426f","Type":"ContainerStarted","Data":"511ab70c0f73049381470473c4edb909b06053d72d60182be14f839baa936f6d"}
Jul 09 17:27:36.711748 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:36.711670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:36.733883 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:36.733832    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx" podStartSLOduration=1.733793852 podStartE2EDuration="1.733793852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:27:36.732075277 +0000 UTC m=+1126.439288222" watchObservedRunningTime="2026-07-09 17:27:36.733793852 +0000 UTC m=+1126.441006799"
Jul 09 17:27:42.990722 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:42.990686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:27:43.092996 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:43.092944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:27:47.719162 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:47.719127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mftxx"
Jul 09 17:27:52.543127 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:52.543089    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:27:52.603535 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:27:52.603481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:00.146708 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:00.146605    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"]
Jul 09 17:30:00.151270 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:00.151244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"
Jul 09 17:30:00.153695 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:00.153668    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vzm9h\""
Jul 09 17:30:00.160708 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:00.160686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"
Jul 09 17:30:00.164168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:00.164143    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"]
Jul 09 17:30:00.297278 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:00.297247    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"]
Jul 09 17:30:00.299017 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:30:00.298985    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565a5dc6_a14c_4374_a8bc_11b11afded43.slice/crio-ea2b64531f07daf4ae9e27a00650a7dd6b4fbc09c494c88f3e5cdc1f7742183c WatchSource:0}: Error finding container ea2b64531f07daf4ae9e27a00650a7dd6b4fbc09c494c88f3e5cdc1f7742183c: Status 404 returned error can't find the container with id ea2b64531f07daf4ae9e27a00650a7dd6b4fbc09c494c88f3e5cdc1f7742183c
Jul 09 17:30:00.300882 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:00.300861    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:30:00.363613 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:00.363576    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb" event={"ID":"565a5dc6-a14c-4374-a8bc-11b11afded43","Type":"ContainerStarted","Data":"ea2b64531f07daf4ae9e27a00650a7dd6b4fbc09c494c88f3e5cdc1f7742183c"}
Jul 09 17:30:03.383639 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:03.383533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb" event={"ID":"565a5dc6-a14c-4374-a8bc-11b11afded43","Type":"ContainerStarted","Data":"0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e"}
Jul 09 17:30:03.399059 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:03.399004    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb" podStartSLOduration=0.631429859 podStartE2EDuration="3.398985581s" totalImagesPullingTime="2.767555722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:03.397135442 +0000 UTC m=+1273.104348386" watchObservedRunningTime="2026-07-09 17:30:03.398985581 +0000 UTC m=+1273.106198527"
Jul 09 17:30:50.956877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:30:50.956835    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:00.010068 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:00.010031    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"]
Jul 09 17:31:00.010517 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:00.010266    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb" podUID="565a5dc6-a14c-4374-a8bc-11b11afded43" containerName="cleanup" containerID="cri-o://0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e" gracePeriod=30
Jul 09 17:31:07.645920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:07.645880    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:30.214146 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.214119    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"
Jul 09 17:31:30.783194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.783160    2579 generic.go:356] "Generic (PLEG): container finished" podID="565a5dc6-a14c-4374-a8bc-11b11afded43" containerID="0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e" exitCode=137
Jul 09 17:31:30.783382 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.783205    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"
Jul 09 17:31:30.783382 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.783250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb" event={"ID":"565a5dc6-a14c-4374-a8bc-11b11afded43","Type":"ContainerDied","Data":"0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e"}
Jul 09 17:31:30.783382 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.783305    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb" event={"ID":"565a5dc6-a14c-4374-a8bc-11b11afded43","Type":"ContainerDied","Data":"ea2b64531f07daf4ae9e27a00650a7dd6b4fbc09c494c88f3e5cdc1f7742183c"}
Jul 09 17:31:30.783382 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.783330    2579 scope.go:117] "RemoveContainer" containerID="0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e"
Jul 09 17:31:30.792761 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.792742    2579 scope.go:117] "RemoveContainer" containerID="0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e"
Jul 09 17:31:30.793086 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:31:30.793065    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e\": container with ID starting with 0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e not found: ID does not exist" containerID="0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e"
Jul 09 17:31:30.793159 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.793096    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e"} err="failed to get container status \"0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e\": rpc error: code = NotFound desc = could not find container \"0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e\": container with ID starting with 0c6d7b0a2545ba29729f81c2be061d1ff9380bd691ae581fa7e70ff2d4cc844e not found: ID does not exist"
Jul 09 17:31:30.804430 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.804396    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"]
Jul 09 17:31:30.809457 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.809426    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-2j7fb"]
Jul 09 17:31:30.815900 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:31:30.815865    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="565a5dc6-a14c-4374-a8bc-11b11afded43" path="/var/lib/kubelet/pods/565a5dc6-a14c-4374-a8bc-11b11afded43/volumes"
Jul 09 17:33:26.626219 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:26.626178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:33.235004 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:33.234967    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:41.484587 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:41.484548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:46.607407 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:46.607347    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:49.728608 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:49.728569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:49.951590 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:49.951557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:50.052148 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:50.052100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:55.646041 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:55.646007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:55.746316 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:55.746281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:55.847309 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:55.847265    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:55.947831 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:55.947722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:56.938261 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:56.938213    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:57.036932 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:57.036900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:57.100853 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:57.100802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:57.398675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:57.398640    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:57.598024 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:57.597989    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:57.698790 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:57.698685    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:59.615842 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:33:59.615786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:02.079704 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:02.079658    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:02.267704 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:02.267662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:02.366560 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:02.366476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:02.438319 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:02.438289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:03.614980 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:03.614949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:08.153775 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:08.153743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:08.215107 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:08.215078    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:08.361390 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:08.361362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:08.424715 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:08.424567    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:09.454174 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:09.454135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:09.551012 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:09.550962    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:09.924555 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:09.924523    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:10.120585 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:10.120551    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:10.260722 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:10.260660    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:10.365698 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:10.365658    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:11.811443 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:11.811407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:14.605375 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:14.605331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:14.975288 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:14.975193    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:20.700174 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:20.700137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:20.807335 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:20.807242    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:23.261333 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:23.261300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:26.513334 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:26.513291    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:26.575154 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:26.575119    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:26.722326 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:26.722269    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:26.817907 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:26.817775    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:27.875369 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:27.875323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:27.955833 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:27.955789    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:28.032820 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:28.032771    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:28.131883 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:28.131788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:28.416423 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:28.416334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:28.516992 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:28.516956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:30.161080 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:30.161018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:32.304288 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:32.304251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:32.534772 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:32.534725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:32.635473 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:32.635356    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:32.709005 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:32.708965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:34.534036 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:34.534002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:38.232996 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:38.232956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:38.292981 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:38.292951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:38.725597 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:38.725567    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:38.825334 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:38.825302    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:38.883948 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:38.883907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:40.365528 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:40.365486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:45.272227 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:45.272181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:45.977083 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:45.977045    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:46.078882 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:46.078844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:46.177913 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:46.177881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:46.278252 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:46.278177    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:46.699447 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:46.699337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:56.782752 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:34:56.782713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:12.732152 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:12.732120    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:18.317532 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:18.317495    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:18.421511 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:18.421475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:18.522185 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:18.522144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:28.084374 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:28.084334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:34.413081 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:34.413042    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:40.084667 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:40.084632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:40.188283 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:40.188247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:40.283194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:40.283156    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:50.831966 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:50.831892    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:51.651586 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:51.651543    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:57.276030 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:57.275996    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:57.348240 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:57.348205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:57.410839 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:57.410779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:57.510367 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:57.510338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:57.610716 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:57.610616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:58.383326 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:58.383281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:58.504638 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:58.504598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:58.597881 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:35:58.597847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:00.174701 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:00.174664    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:05.836734 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:05.836694    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:05.936649 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:05.936610    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:06.539306 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:06.539272    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:12.263963 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:12.263921    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:12.365327 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:12.365295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:12.510929 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:12.510890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:12.820735 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:12.820695    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:12.979877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:12.979839    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:15.981890 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:15.981853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:16.081701 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:16.081667    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:16.220732 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:16.220694    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:16.631474 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:16.631441    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:16.733044 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:16.733003    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:16.974320 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:16.974234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:20.504319 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:20.504287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:21.158784 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:21.158750    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:21.259161 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:21.259127    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:21.617790 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:21.617742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:27.365005 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:27.364961    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:27.466336 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:27.466295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:27.733001 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:27.732910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:28.147853 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:28.147769    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:28.197752 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:28.197721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:33.878918 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:33.878885    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:33.979612 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:33.979576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:34.120263 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:34.120227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:34.346549 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:34.346508    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:34.476972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:34.476930    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:34.578776 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:34.578748    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:34.715327 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:34.715247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:40.363200 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:40.363164    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:40.422557 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:40.422527    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:40.501228 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:40.501195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:40.600866 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:40.600833    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:40.701074 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:40.700994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:46.520028 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:46.519991    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:46.620166 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:46.620136    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:53.250683 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:53.250647    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:53.674080 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:53.673989    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:54.135054 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:54.135015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:56.203143 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:56.203113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:56.278105 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:56.278072    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:56.352241 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:56.352214    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:56.628555 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:56.628516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:56.756275 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:56.756238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:56.859314 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:36:56.859277    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:00.717181 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:00.717150    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:06.075766 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:06.075720    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:06.176338 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:06.176298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:07.197223 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:07.197185    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:17.492768 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:17.492677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:17.595952 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:17.595919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:32.221409 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:32.221369    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:34.381447 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:34.381408    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:34.791499 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:34.791467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:40.496566 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:40.496517    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:45.521513 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:37:45.521475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:22.054717 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:22.054660    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:22.505217 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:22.505185    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:28.055439 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:28.055396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:33.733867 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:33.733832    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:33.841177 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:33.841139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:34.042262 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:34.042230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:34.261849 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:34.261803    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:35.395092 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:35.395060    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:35.489127 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:35.489088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:35.589789 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:35.589756    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:36.317399 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:36.317368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:36.414316 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:36.414280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:36.515245 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:36.515212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:37.944185 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:37.944151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:43.575183 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:43.575087    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:43.676276 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:43.676223    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:44.265307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:44.265271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:50.344085 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:50.344052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:50.443976 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:50.443941    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:50.554511 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:38:50.554481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:01.123755 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:01.123723    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:01.474675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:01.474587    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:22.463881 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:22.463837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:25.573624 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:25.573591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:25.674635 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:25.674604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:28.357282 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:28.357249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:28.457205 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:28.457161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:28.703302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:28.703220    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:29.026137 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:29.026097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:29.605466 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:29.605428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:32.081441 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:32.081394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:32.162994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:32.162957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:32.239848 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:32.239803    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:32.728999 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:32.728952    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:32.829290 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:32.829259    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:36.586050 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:36.586011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:36.962227 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:36.962137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:37.345044 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:37.345008    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:37.484655 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:37.484622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:40.067426 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.067388    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:40.156623 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.156592    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"]
Jul 09 17:39:40.156962 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.156949    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="565a5dc6-a14c-4374-a8bc-11b11afded43" containerName="cleanup"
Jul 09 17:39:40.157021 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.156964    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="565a5dc6-a14c-4374-a8bc-11b11afded43" containerName="cleanup"
Jul 09 17:39:40.157059 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.157049    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="565a5dc6-a14c-4374-a8bc-11b11afded43" containerName="cleanup"
Jul 09 17:39:40.159439 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.159418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:40.160052 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.160038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.168294 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.168269    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-bc6ff5-serving-cert\""
Jul 09 17:39:40.168412 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.168357    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cd4gx\""
Jul 09 17:39:40.179623 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.179590    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"]
Jul 09 17:39:40.250637 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.250596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrbht\" (UniqueName: \"kubernetes.io/projected/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-kube-api-access-qrbht\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.250637 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.250638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.250904 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.250690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.341805 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.341694    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:40.351921 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.351888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrbht\" (UniqueName: \"kubernetes.io/projected/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-kube-api-access-qrbht\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.351921 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.351925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.352118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.351952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.352118 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:39:40.352045    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-serving-cert: secret "maas-api-e2e-inf-b-bc6ff5-serving-cert" not found
Jul 09 17:39:40.352118 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:39:40.352106    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls podName:1dfda47b-3fb9-4c5a-a7ec-a562f121ba11 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:40.85209051 +0000 UTC m=+1850.559303434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls") pod "maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv" (UID: "1dfda47b-3fb9-4c5a-a7ec-a562f121ba11") : secret "maas-api-e2e-inf-b-bc6ff5-serving-cert" not found
Jul 09 17:39:40.352632 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.352612    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.374495 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.374467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrbht\" (UniqueName: \"kubernetes.io/projected/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-kube-api-access-qrbht\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.497168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.497114    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:40.848760 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.848709    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:40.854891 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.854860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.857481 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.857456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:40.946873 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:40.946837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:41.070049 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:41.070013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:41.218093 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:41.218069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"]
Jul 09 17:39:41.220743 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:39:41.220703    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfda47b_3fb9_4c5a_a7ec_a562f121ba11.slice/crio-b114b0912f0828dc66f58d7c4f94f58738130241a23950cd6865ac31b3a84faf WatchSource:0}: Error finding container b114b0912f0828dc66f58d7c4f94f58738130241a23950cd6865ac31b3a84faf: Status 404 returned error can't find the container with id b114b0912f0828dc66f58d7c4f94f58738130241a23950cd6865ac31b3a84faf
Jul 09 17:39:41.223051 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:41.223026    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:39:42.054542 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:42.054503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv" event={"ID":"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11","Type":"ContainerStarted","Data":"b114b0912f0828dc66f58d7c4f94f58738130241a23950cd6865ac31b3a84faf"}
Jul 09 17:39:43.061446 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:43.061412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv" event={"ID":"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11","Type":"ContainerStarted","Data":"57ff4a78227c6f4f44069c1e56e235abc9b3ae17e2845187725c523c1527e8da"}
Jul 09 17:39:43.062027 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:43.061479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:43.079939 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:43.079889    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv" podStartSLOduration=1.45833283 podStartE2EDuration="3.079871933s" totalImagesPullingTime="1.621539103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:43.078950406 +0000 UTC m=+1852.786163385" watchObservedRunningTime="2026-07-09 17:39:43.079871933 +0000 UTC m=+1852.787084879"
Jul 09 17:39:44.593787 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:44.593751    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:49.072235 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:49.072208    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:39:52.795003 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.794968    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"]
Jul 09 17:39:52.798236 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.798216    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.800889 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.800860    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-dd4cf6\"/\"kube-root-ca.crt\""
Jul 09 17:39:52.801704 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.801684    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-dd4cf6\"/\"openshift-service-ca.crt\""
Jul 09 17:39:52.801845 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.801778    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-dd4cf6\"/\"test-model-dd4cf6-kserve-self-signed-certs\""
Jul 09 17:39:52.801927 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.801894    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-dd4cf6\"/\"default-dockercfg-88lrm\""
Jul 09 17:39:52.809803 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.809777    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"]
Jul 09 17:39:52.862079 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.862048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-dshm\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.862284 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.862110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tls-certs\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.862284 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.862131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdxdx\" (UniqueName: \"kubernetes.io/projected/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-kube-api-access-fdxdx\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.862284 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.862158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-model-cache\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.862284 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.862216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tmp-dir\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.862536 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.862308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-home\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.883492 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.883443    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:52.963560 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.963527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-model-cache\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.963759 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.963580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tmp-dir\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.963759 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.963621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-home\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.963759 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.963645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-dshm\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.963759 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.963675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tls-certs\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.963759 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.963701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdxdx\" (UniqueName: \"kubernetes.io/projected/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-kube-api-access-fdxdx\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.964069 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.964050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-model-cache\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.964247 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.964224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tmp-dir\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.964333 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.964261    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-home\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.966530 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.966507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-dshm\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.966762 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.966743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tls-certs\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:52.973037 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:52.972998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdxdx\" (UniqueName: \"kubernetes.io/projected/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-kube-api-access-fdxdx\") pod \"test-model-dd4cf6-kserve-54fdd44555-7qqxx\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") " pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:53.107546 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:53.107460    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:39:53.255388 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:53.255359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"]
Jul 09 17:39:53.257651 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:39:53.257622    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7aa3a65f_0ab7_49a0_99a8_132f7de4b0b1.slice/crio-122b662fb448a6c5b702f773e4ed07c4a472abbfc55aec0a2ce543283972f0f7 WatchSource:0}: Error finding container 122b662fb448a6c5b702f773e4ed07c4a472abbfc55aec0a2ce543283972f0f7: Status 404 returned error can't find the container with id 122b662fb448a6c5b702f773e4ed07c4a472abbfc55aec0a2ce543283972f0f7
Jul 09 17:39:53.498526 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:53.498491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:53.599953 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:53.599917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:54.113081 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:54.113046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx" event={"ID":"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1","Type":"ContainerStarted","Data":"37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86"}
Jul 09 17:39:54.113473 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:54.113090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx" event={"ID":"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1","Type":"ContainerStarted","Data":"122b662fb448a6c5b702f773e4ed07c4a472abbfc55aec0a2ce543283972f0f7"}
Jul 09 17:39:54.133196 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:39:54.133135    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx" podStartSLOduration=2.133117121 podStartE2EDuration="2.133117121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:54.130955835 +0000 UTC m=+1863.838168780" watchObservedRunningTime="2026-07-09 17:39:54.133117121 +0000 UTC m=+1863.840330119"
Jul 09 17:40:01.869701 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:01.869666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:01.985746 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:01.985718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:03.107879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:03.107842    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:40:03.107879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:03.107889    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:40:03.120504 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:03.120466    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:40:03.167411 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:03.167383    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:40:14.305234 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:14.305147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:33.382366 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:33.382332    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"]
Jul 09 17:40:33.410986 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:33.410938    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:34.356323 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:34.356290    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:34.801586 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:34.801553    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.088109 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:35.088026    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.199510 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:35.199477    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.289364 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:35.289331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.406846 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:35.406742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:40.162029 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:40.161992    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:48.402872 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.402807    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx" podUID="7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" containerName="main" containerID="cri-o://37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86" gracePeriod=45
Jul 09 17:40:48.655045 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.654979    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:40:48.750203 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750157    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-home\") pod \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") "
Jul 09 17:40:48.750411 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750226    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-dshm\") pod \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") "
Jul 09 17:40:48.750411 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750272    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdxdx\" (UniqueName: \"kubernetes.io/projected/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-kube-api-access-fdxdx\") pod \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") "
Jul 09 17:40:48.750411 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750307    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tmp-dir\") pod \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") "
Jul 09 17:40:48.750411 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750330    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-model-cache\") pod \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") "
Jul 09 17:40:48.750411 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750357    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tls-certs\") pod \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\" (UID: \"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1\") "
Jul 09 17:40:48.750675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750508    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-home" (OuterVolumeSpecName: "home") pod "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" (UID: "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:40:48.750675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750600    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-home\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:40:48.750675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750595    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" (UID: "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:40:48.750675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.750610    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" (UID: "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:40:48.752570 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.752541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-dshm" (OuterVolumeSpecName: "dshm") pod "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" (UID: "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:40:48.752697 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.752651    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-kube-api-access-fdxdx" (OuterVolumeSpecName: "kube-api-access-fdxdx") pod "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" (UID: "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1"). InnerVolumeSpecName "kube-api-access-fdxdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:40:48.752697 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.752680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" (UID: "7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:40:48.851642 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.851599    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-dshm\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:40:48.851642 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.851635    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdxdx\" (UniqueName: \"kubernetes.io/projected/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-kube-api-access-fdxdx\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:40:48.851899 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.851669    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tmp-dir\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:40:48.851899 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.851680    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-model-cache\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:40:48.851899 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:48.851688    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1-tls-certs\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:40:49.377671 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.377630    2579 generic.go:356] "Generic (PLEG): container finished" podID="7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" containerID="37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86" exitCode=0
Jul 09 17:40:49.377875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.377697    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"
Jul 09 17:40:49.377875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.377711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx" event={"ID":"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1","Type":"ContainerDied","Data":"37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86"}
Jul 09 17:40:49.377875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.377758    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx" event={"ID":"7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1","Type":"ContainerDied","Data":"122b662fb448a6c5b702f773e4ed07c4a472abbfc55aec0a2ce543283972f0f7"}
Jul 09 17:40:49.377875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.377775    2579 scope.go:117] "RemoveContainer" containerID="37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86"
Jul 09 17:40:49.386602 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.386581    2579 scope.go:117] "RemoveContainer" containerID="37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86"
Jul 09 17:40:49.386906 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:40:49.386883    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86\": container with ID starting with 37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86 not found: ID does not exist" containerID="37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86"
Jul 09 17:40:49.386994 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.386915    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86"} err="failed to get container status \"37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86\": rpc error: code = NotFound desc = could not find container \"37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86\": container with ID starting with 37aa3d48bb07dc0f2e300478b43bc0ebb377282a47039a394a3c6471d99d7d86 not found: ID does not exist"
Jul 09 17:40:49.393538 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.393509    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"]
Jul 09 17:40:49.397408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:49.397382    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-dd4cf6/test-model-dd4cf6-kserve-54fdd44555-7qqxx"]
Jul 09 17:40:50.816107 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:40:50.816074    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" path="/var/lib/kubelet/pods/7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1/volumes"
Jul 09 17:41:16.816561 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:16.816525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:17.125773 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:17.125679    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:17.454905 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:17.454787    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:17.595676 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:17.595584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:18.046166 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.046134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:18.147881 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.147834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:18.245200 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.245163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:18.354043 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.353933    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"]
Jul 09 17:41:18.354259 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.354230    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv" podUID="1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" containerName="maas-api" containerID="cri-o://57ff4a78227c6f4f44069c1e56e235abc9b3ae17e2845187725c523c1527e8da" gracePeriod=30
Jul 09 17:41:18.377260 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.377229    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:18.514086 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.514051    2579 generic.go:356] "Generic (PLEG): container finished" podID="1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" containerID="57ff4a78227c6f4f44069c1e56e235abc9b3ae17e2845187725c523c1527e8da" exitCode=0
Jul 09 17:41:18.514275 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.514121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv" event={"ID":"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11","Type":"ContainerDied","Data":"57ff4a78227c6f4f44069c1e56e235abc9b3ae17e2845187725c523c1527e8da"}
Jul 09 17:41:18.623123 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.623090    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:41:18.716253 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.716214    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls\") pod \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") "
Jul 09 17:41:18.716408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.716280    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrbht\" (UniqueName: \"kubernetes.io/projected/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-kube-api-access-qrbht\") pod \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") "
Jul 09 17:41:18.716408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.716312    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-openshift-service-ca\") pod \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\" (UID: \"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11\") "
Jul 09 17:41:18.716716 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.716693    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" (UID: "1dfda47b-3fb9-4c5a-a7ec-a562f121ba11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:41:18.718471 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.718445    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" (UID: "1dfda47b-3fb9-4c5a-a7ec-a562f121ba11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:41:18.718594 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.718468    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-kube-api-access-qrbht" (OuterVolumeSpecName: "kube-api-access-qrbht") pod "1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" (UID: "1dfda47b-3fb9-4c5a-a7ec-a562f121ba11"). InnerVolumeSpecName "kube-api-access-qrbht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:41:18.817031 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.817002    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-maas-api-tls\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:18.817031 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.817030    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrbht\" (UniqueName: \"kubernetes.io/projected/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-kube-api-access-qrbht\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:18.817031 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:18.817040    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11-openshift-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:19.519706 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:19.519668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv" event={"ID":"1dfda47b-3fb9-4c5a-a7ec-a562f121ba11","Type":"ContainerDied","Data":"b114b0912f0828dc66f58d7c4f94f58738130241a23950cd6865ac31b3a84faf"}
Jul 09 17:41:19.520156 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:19.519745    2579 scope.go:117] "RemoveContainer" containerID="57ff4a78227c6f4f44069c1e56e235abc9b3ae17e2845187725c523c1527e8da"
Jul 09 17:41:19.520156 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:19.519682    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"
Jul 09 17:41:19.536609 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:19.536578    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"]
Jul 09 17:41:19.540166 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:19.540128    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc6ff5-6bc7f76dd5-zdnwv"]
Jul 09 17:41:20.815918 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:20.815881    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" path="/var/lib/kubelet/pods/1dfda47b-3fb9-4c5a-a7ec-a562f121ba11/volumes"
Jul 09 17:41:23.747185 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:23.747143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:23.811861 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:23.811804    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:24.070598 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:24.070503    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:24.349307 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:24.349205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:24.748193 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:24.748149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:25.102255 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:25.102160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:25.449645 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:25.449549    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:27.832471 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.832426    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:27.974436 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.974402    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"]
Jul 09 17:41:27.974762 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.974750    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" containerName="main"
Jul 09 17:41:27.974762 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.974762    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" containerName="main"
Jul 09 17:41:27.974868 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.974778    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" containerName="maas-api"
Jul 09 17:41:27.974868 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.974785    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" containerName="maas-api"
Jul 09 17:41:27.974868 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.974853    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aa3a65f-0ab7-49a0-99a8-132f7de4b0b1" containerName="main"
Jul 09 17:41:27.974868 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.974862    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dfda47b-3fb9-4c5a-a7ec-a562f121ba11" containerName="maas-api"
Jul 09 17:41:27.977821 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.977795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:27.981442 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.981419    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-beee07-serving-cert\""
Jul 09 17:41:27.981594 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.981531    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cd4gx\""
Jul 09 17:41:27.998665 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:27.998629    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"]
Jul 09 17:41:28.001663 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.001626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:28.099859 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.099740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0061517-9410-4e6c-8a6a-e782563262ef-openshift-service-ca\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.099859 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.099795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0061517-9410-4e6c-8a6a-e782563262ef-maas-api-tls\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.100072 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.099874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94mmn\" (UniqueName: \"kubernetes.io/projected/e0061517-9410-4e6c-8a6a-e782563262ef-kube-api-access-94mmn\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.100239 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.100217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:28.201222 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.201184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0061517-9410-4e6c-8a6a-e782563262ef-openshift-service-ca\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.201222 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.201225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0061517-9410-4e6c-8a6a-e782563262ef-maas-api-tls\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.201453 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.201280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94mmn\" (UniqueName: \"kubernetes.io/projected/e0061517-9410-4e6c-8a6a-e782563262ef-kube-api-access-94mmn\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.201966 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.201942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0061517-9410-4e6c-8a6a-e782563262ef-openshift-service-ca\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.204110 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.204081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0061517-9410-4e6c-8a6a-e782563262ef-maas-api-tls\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.213200 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.213169    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94mmn\" (UniqueName: \"kubernetes.io/projected/e0061517-9410-4e6c-8a6a-e782563262ef-kube-api-access-94mmn\") pod \"maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.251569 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.251508    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:28.288519 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.288471    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:28.435068 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.435043    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"]
Jul 09 17:41:28.437739 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:41:28.437710    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0061517_9410_4e6c_8a6a_e782563262ef.slice/crio-7d6818b9a92861076ebf97aace61f7df95138a3460f925328efebc06934b5d33 WatchSource:0}: Error finding container 7d6818b9a92861076ebf97aace61f7df95138a3460f925328efebc06934b5d33: Status 404 returned error can't find the container with id 7d6818b9a92861076ebf97aace61f7df95138a3460f925328efebc06934b5d33
Jul 09 17:41:28.548582 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.548546    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:28.569122 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.569079    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v" event={"ID":"e0061517-9410-4e6c-8a6a-e782563262ef","Type":"ContainerStarted","Data":"7d6818b9a92861076ebf97aace61f7df95138a3460f925328efebc06934b5d33"}
Jul 09 17:41:28.649062 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:28.648943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:29.575867 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:29.575803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v" event={"ID":"e0061517-9410-4e6c-8a6a-e782563262ef","Type":"ContainerStarted","Data":"7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712"}
Jul 09 17:41:29.576273 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:29.575930    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:29.592247 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:29.592190    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v" podStartSLOduration=2.168112147 podStartE2EDuration="2.592169833s" totalImagesPullingTime="424.057686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:41:29.591371446 +0000 UTC m=+1959.298584410" watchObservedRunningTime="2026-07-09 17:41:29.592169833 +0000 UTC m=+1959.299382811"
Jul 09 17:41:32.298574 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:32.298530    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:32.768520 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:32.768488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:33.103639 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:33.103551    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:33.979877 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:33.979806    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:35.586790 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.586762    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:35.863592 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.863500    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:35.939093 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.939057    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"]
Jul 09 17:41:35.940450 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.940409    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:35.943364 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.943341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:35.945671 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.945648    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-b6bea1-serving-cert\""
Jul 09 17:41:35.950336 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.950309    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"]
Jul 09 17:41:35.972455 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.972424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a703ada9-82f1-4204-a86e-9e4774222a35-maas-api-tls\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:35.972649 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.972459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a703ada9-82f1-4204-a86e-9e4774222a35-openshift-service-ca\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:35.972649 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:35.972543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rng5w\" (UniqueName: \"kubernetes.io/projected/a703ada9-82f1-4204-a86e-9e4774222a35-kube-api-access-rng5w\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:36.005271 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.005226    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:36.073267 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.073227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a703ada9-82f1-4204-a86e-9e4774222a35-maas-api-tls\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:36.073267 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.073266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a703ada9-82f1-4204-a86e-9e4774222a35-openshift-service-ca\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:36.073556 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.073318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng5w\" (UniqueName: \"kubernetes.io/projected/a703ada9-82f1-4204-a86e-9e4774222a35-kube-api-access-rng5w\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:36.074047 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.074026    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a703ada9-82f1-4204-a86e-9e4774222a35-openshift-service-ca\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:36.075964 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.075933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a703ada9-82f1-4204-a86e-9e4774222a35-maas-api-tls\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:36.084544 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.084508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rng5w\" (UniqueName: \"kubernetes.io/projected/a703ada9-82f1-4204-a86e-9e4774222a35-kube-api-access-rng5w\") pod \"maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:36.104627 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.104590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:36.256665 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.256629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:36.408306 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.408243    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"]
Jul 09 17:41:36.410592 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:41:36.410562    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda703ada9_82f1_4204_a86e_9e4774222a35.slice/crio-22ba455137adbbe41fc9e386d539588d1635023aeb60e1cbf1ab14cdfb6453e2 WatchSource:0}: Error finding container 22ba455137adbbe41fc9e386d539588d1635023aeb60e1cbf1ab14cdfb6453e2: Status 404 returned error can't find the container with id 22ba455137adbbe41fc9e386d539588d1635023aeb60e1cbf1ab14cdfb6453e2
Jul 09 17:41:36.509459 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.509377    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:36.609078 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.609039    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw" event={"ID":"a703ada9-82f1-4204-a86e-9e4774222a35","Type":"ContainerStarted","Data":"22ba455137adbbe41fc9e386d539588d1635023aeb60e1cbf1ab14cdfb6453e2"}
Jul 09 17:41:36.610380 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:36.610358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:37.616306 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:37.616271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw" event={"ID":"a703ada9-82f1-4204-a86e-9e4774222a35","Type":"ContainerStarted","Data":"51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d"}
Jul 09 17:41:37.616697 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:37.616334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:37.633222 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:37.633173    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw" podStartSLOduration=2.084962753 podStartE2EDuration="2.633153847s" totalImagesPullingTime="548.191094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:41:37.631658792 +0000 UTC m=+1967.338871738" watchObservedRunningTime="2026-07-09 17:41:37.633153847 +0000 UTC m=+1967.340366793"
Jul 09 17:41:40.388352 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:40.388319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:43.629132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:43.629052    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:48.779505 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:48.779467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:49.154745 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.154659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:49.252101 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.252061    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:49.369141 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.369110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:49.578751 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.578716    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"]
Jul 09 17:41:49.578963 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.578937    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v" podUID="e0061517-9410-4e6c-8a6a-e782563262ef" containerName="maas-api" containerID="cri-o://7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712" gracePeriod=30
Jul 09 17:41:49.607540 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.607506    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:49.837207 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.837140    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:49.896986 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.896940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94mmn\" (UniqueName: \"kubernetes.io/projected/e0061517-9410-4e6c-8a6a-e782563262ef-kube-api-access-94mmn\") pod \"e0061517-9410-4e6c-8a6a-e782563262ef\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") "
Jul 09 17:41:49.897161 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.897021    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0061517-9410-4e6c-8a6a-e782563262ef-openshift-service-ca\") pod \"e0061517-9410-4e6c-8a6a-e782563262ef\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") "
Jul 09 17:41:49.897161 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.897041    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0061517-9410-4e6c-8a6a-e782563262ef-maas-api-tls\") pod \"e0061517-9410-4e6c-8a6a-e782563262ef\" (UID: \"e0061517-9410-4e6c-8a6a-e782563262ef\") "
Jul 09 17:41:49.897348 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.897324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0061517-9410-4e6c-8a6a-e782563262ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0061517-9410-4e6c-8a6a-e782563262ef" (UID: "e0061517-9410-4e6c-8a6a-e782563262ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:41:49.899197 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.899160    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0061517-9410-4e6c-8a6a-e782563262ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0061517-9410-4e6c-8a6a-e782563262ef" (UID: "e0061517-9410-4e6c-8a6a-e782563262ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:41:49.899317 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.899263    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0061517-9410-4e6c-8a6a-e782563262ef-kube-api-access-94mmn" (OuterVolumeSpecName: "kube-api-access-94mmn") pod "e0061517-9410-4e6c-8a6a-e782563262ef" (UID: "e0061517-9410-4e6c-8a6a-e782563262ef"). InnerVolumeSpecName "kube-api-access-94mmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:41:49.998125 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.998081    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94mmn\" (UniqueName: \"kubernetes.io/projected/e0061517-9410-4e6c-8a6a-e782563262ef-kube-api-access-94mmn\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:49.998125 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.998116    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0061517-9410-4e6c-8a6a-e782563262ef-openshift-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:49.998125 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:49.998128    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0061517-9410-4e6c-8a6a-e782563262ef-maas-api-tls\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:50.686281 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.686240    2579 generic.go:356] "Generic (PLEG): container finished" podID="e0061517-9410-4e6c-8a6a-e782563262ef" containerID="7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712" exitCode=0
Jul 09 17:41:50.686493 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.686292    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"
Jul 09 17:41:50.686493 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.686315    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v" event={"ID":"e0061517-9410-4e6c-8a6a-e782563262ef","Type":"ContainerDied","Data":"7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712"}
Jul 09 17:41:50.686493 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.686369    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v" event={"ID":"e0061517-9410-4e6c-8a6a-e782563262ef","Type":"ContainerDied","Data":"7d6818b9a92861076ebf97aace61f7df95138a3460f925328efebc06934b5d33"}
Jul 09 17:41:50.686493 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.686392    2579 scope.go:117] "RemoveContainer" containerID="7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712"
Jul 09 17:41:50.698264 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.698242    2579 scope.go:117] "RemoveContainer" containerID="7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712"
Jul 09 17:41:50.698605 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:41:50.698577    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712\": container with ID starting with 7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712 not found: ID does not exist" containerID="7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712"
Jul 09 17:41:50.698686 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.698621    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712"} err="failed to get container status \"7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712\": rpc error: code = NotFound desc = could not find container \"7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712\": container with ID starting with 7be1b759d28c3b8b53e37b4802cad0238410afb22c69fd0fcead19e1029b6712 not found: ID does not exist"
Jul 09 17:41:50.708392 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.708357    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"]
Jul 09 17:41:50.711851 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.711807    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-beee07-58d9c7f6f5-8kf5v"]
Jul 09 17:41:50.815560 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:50.815526    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0061517-9410-4e6c-8a6a-e782563262ef" path="/var/lib/kubelet/pods/e0061517-9410-4e6c-8a6a-e782563262ef/volumes"
Jul 09 17:41:54.850452 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:54.850414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:54.909228 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:54.909191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:55.127580 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:55.127486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:55.348200 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:55.348169    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:55.527782 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:55.527748    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:55.959225 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:55.959100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:56.059601 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.059553    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:56.198613 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.198564    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"]
Jul 09 17:41:56.198875 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.198837    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw" podUID="a703ada9-82f1-4204-a86e-9e4774222a35" containerName="maas-api" containerID="cri-o://51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d" gracePeriod=30
Jul 09 17:41:56.240718 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.240686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:56.458180 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.458155    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:56.557798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.557753    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a703ada9-82f1-4204-a86e-9e4774222a35-maas-api-tls\") pod \"a703ada9-82f1-4204-a86e-9e4774222a35\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") "
Jul 09 17:41:56.557798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.557804    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a703ada9-82f1-4204-a86e-9e4774222a35-openshift-service-ca\") pod \"a703ada9-82f1-4204-a86e-9e4774222a35\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") "
Jul 09 17:41:56.558085 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.557880    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rng5w\" (UniqueName: \"kubernetes.io/projected/a703ada9-82f1-4204-a86e-9e4774222a35-kube-api-access-rng5w\") pod \"a703ada9-82f1-4204-a86e-9e4774222a35\" (UID: \"a703ada9-82f1-4204-a86e-9e4774222a35\") "
Jul 09 17:41:56.558260 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.558234    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a703ada9-82f1-4204-a86e-9e4774222a35-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a703ada9-82f1-4204-a86e-9e4774222a35" (UID: "a703ada9-82f1-4204-a86e-9e4774222a35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:41:56.559920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.559895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a703ada9-82f1-4204-a86e-9e4774222a35-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a703ada9-82f1-4204-a86e-9e4774222a35" (UID: "a703ada9-82f1-4204-a86e-9e4774222a35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:41:56.560012 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.559963    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a703ada9-82f1-4204-a86e-9e4774222a35-kube-api-access-rng5w" (OuterVolumeSpecName: "kube-api-access-rng5w") pod "a703ada9-82f1-4204-a86e-9e4774222a35" (UID: "a703ada9-82f1-4204-a86e-9e4774222a35"). InnerVolumeSpecName "kube-api-access-rng5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:41:56.659059 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.659016    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rng5w\" (UniqueName: \"kubernetes.io/projected/a703ada9-82f1-4204-a86e-9e4774222a35-kube-api-access-rng5w\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:56.659059 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.659051    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a703ada9-82f1-4204-a86e-9e4774222a35-maas-api-tls\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:56.659059 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.659064    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a703ada9-82f1-4204-a86e-9e4774222a35-openshift-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:41:56.715504 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.715475    2579 generic.go:356] "Generic (PLEG): container finished" podID="a703ada9-82f1-4204-a86e-9e4774222a35" containerID="51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d" exitCode=0
Jul 09 17:41:56.715666 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.715516    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"
Jul 09 17:41:56.715666 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.715558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw" event={"ID":"a703ada9-82f1-4204-a86e-9e4774222a35","Type":"ContainerDied","Data":"51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d"}
Jul 09 17:41:56.715666 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.715614    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw" event={"ID":"a703ada9-82f1-4204-a86e-9e4774222a35","Type":"ContainerDied","Data":"22ba455137adbbe41fc9e386d539588d1635023aeb60e1cbf1ab14cdfb6453e2"}
Jul 09 17:41:56.715666 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.715643    2579 scope.go:117] "RemoveContainer" containerID="51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d"
Jul 09 17:41:56.726725 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.726706    2579 scope.go:117] "RemoveContainer" containerID="51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d"
Jul 09 17:41:56.727083 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:41:56.727059    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d\": container with ID starting with 51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d not found: ID does not exist" containerID="51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d"
Jul 09 17:41:56.727171 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.727099    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d"} err="failed to get container status \"51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d\": rpc error: code = NotFound desc = could not find container \"51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d\": container with ID starting with 51e06563176a0e1d73658e951f0d635e2ae0500107970386c9e92560b657217d not found: ID does not exist"
Jul 09 17:41:56.739213 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.739184    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"]
Jul 09 17:41:56.744135 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.744109    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b6bea1-695cf745f7-flqcw"]
Jul 09 17:41:56.815767 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:41:56.815684    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a703ada9-82f1-4204-a86e-9e4774222a35" path="/var/lib/kubelet/pods/a703ada9-82f1-4204-a86e-9e4774222a35/volumes"
Jul 09 17:42:01.786013 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:01.785981    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:01.995452 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:01.995419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:02.106641 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:02.106549    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:02.352008 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:02.351955    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:02.694888 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:02.694854    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:03.028235 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:03.028200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:03.525712 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:03.525675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:05.956824 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:05.956769    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:06.145513 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.145486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:06.174720 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.174686    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"]
Jul 09 17:42:06.175154 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.175137    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a703ada9-82f1-4204-a86e-9e4774222a35" containerName="maas-api"
Jul 09 17:42:06.175249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.175157    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a703ada9-82f1-4204-a86e-9e4774222a35" containerName="maas-api"
Jul 09 17:42:06.175249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.175177    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0061517-9410-4e6c-8a6a-e782563262ef" containerName="maas-api"
Jul 09 17:42:06.175249 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.175186    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0061517-9410-4e6c-8a6a-e782563262ef" containerName="maas-api"
Jul 09 17:42:06.175395 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.175307    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a703ada9-82f1-4204-a86e-9e4774222a35" containerName="maas-api"
Jul 09 17:42:06.175395 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.175322    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0061517-9410-4e6c-8a6a-e782563262ef" containerName="maas-api"
Jul 09 17:42:06.179635 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.179606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.182006 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.181978    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-77a679-serving-cert\""
Jul 09 17:42:06.182189 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.182162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cd4gx\""
Jul 09 17:42:06.190006 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.189972    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"]
Jul 09 17:42:06.225083 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.224961    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:06.346051 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.346009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5zp\" (UniqueName: \"kubernetes.io/projected/d8b3f3eb-976d-40ae-81da-18b0cc54919c-kube-api-access-2g5zp\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.346269 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.346149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b3f3eb-976d-40ae-81da-18b0cc54919c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.346269 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.346190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8b3f3eb-976d-40ae-81da-18b0cc54919c-maas-api-tls\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.446696 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.446657    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5zp\" (UniqueName: \"kubernetes.io/projected/d8b3f3eb-976d-40ae-81da-18b0cc54919c-kube-api-access-2g5zp\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.446952 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.446753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b3f3eb-976d-40ae-81da-18b0cc54919c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.446952 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.446779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8b3f3eb-976d-40ae-81da-18b0cc54919c-maas-api-tls\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.447510 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.447477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b3f3eb-976d-40ae-81da-18b0cc54919c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.449396 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.449372    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8b3f3eb-976d-40ae-81da-18b0cc54919c-maas-api-tls\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.456250 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.456222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5zp\" (UniqueName: \"kubernetes.io/projected/d8b3f3eb-976d-40ae-81da-18b0cc54919c-kube-api-access-2g5zp\") pod \"maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.485063 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.484968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:06.492020 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.491984    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:06.647186 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.647159    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"]
Jul 09 17:42:06.649334 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:42:06.649301    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b3f3eb_976d_40ae_81da_18b0cc54919c.slice/crio-9503c42ad7f5e2254242d3403964e762307968089b1b9761e4cfc084f0119b51 WatchSource:0}: Error finding container 9503c42ad7f5e2254242d3403964e762307968089b1b9761e4cfc084f0119b51: Status 404 returned error can't find the container with id 9503c42ad7f5e2254242d3403964e762307968089b1b9761e4cfc084f0119b51
Jul 09 17:42:06.676702 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.676668    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:06.763232 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.763190    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj" event={"ID":"d8b3f3eb-976d-40ae-81da-18b0cc54919c","Type":"ContainerStarted","Data":"9503c42ad7f5e2254242d3403964e762307968089b1b9761e4cfc084f0119b51"}
Jul 09 17:42:06.781314 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:06.781272    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:07.431543 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:07.431448    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:07.531341 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:07.531289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:07.769883 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:07.769845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj" event={"ID":"d8b3f3eb-976d-40ae-81da-18b0cc54919c","Type":"ContainerStarted","Data":"d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3"}
Jul 09 17:42:07.770111 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:07.769941    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:07.788472 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:07.788418    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj" podStartSLOduration=1.428748664 podStartE2EDuration="1.788400062s" totalImagesPullingTime="359.651398ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:42:07.786422288 +0000 UTC m=+1997.493635233" watchObservedRunningTime="2026-07-09 17:42:07.788400062 +0000 UTC m=+1997.495613039"
Jul 09 17:42:08.284753 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:08.284714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:08.388115 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:08.388082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:10.484315 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:10.484270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:10.846182 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:10.846150    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:11.155345 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:11.155237    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:11.741191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:11.741156    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:13.780477 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:13.780448    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:42:14.005578 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.005541    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:14.086479 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.086383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:14.183905 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.183867    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"]
Jul 09 17:42:14.188203 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.188174    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.190546 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.190526    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f62372-serving-cert\""
Jul 09 17:42:14.198771 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.198741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"]
Jul 09 17:42:14.224676 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.224637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:14.320562 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.320514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a6d03b-dca9-4f0a-99e8-f297f083b529-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.320562 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.320563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtr2j\" (UniqueName: \"kubernetes.io/projected/a3a6d03b-dca9-4f0a-99e8-f297f083b529-kube-api-access-vtr2j\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.320846 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.320716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a6d03b-dca9-4f0a-99e8-f297f083b529-maas-api-tls\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.415742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.415646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:14.421902 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.421863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a6d03b-dca9-4f0a-99e8-f297f083b529-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.421902 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.421902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtr2j\" (UniqueName: \"kubernetes.io/projected/a3a6d03b-dca9-4f0a-99e8-f297f083b529-kube-api-access-vtr2j\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.422111 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.421945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a6d03b-dca9-4f0a-99e8-f297f083b529-maas-api-tls\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.422636 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.422604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a6d03b-dca9-4f0a-99e8-f297f083b529-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.424598 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.424571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a6d03b-dca9-4f0a-99e8-f297f083b529-maas-api-tls\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.432394 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.432362    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtr2j\" (UniqueName: \"kubernetes.io/projected/a3a6d03b-dca9-4f0a-99e8-f297f083b529-kube-api-access-vtr2j\") pod \"maas-api-e2e-shared-b-f62372-854877578c-m8wch\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.503096 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.503042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:14.654482 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.654457    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"]
Jul 09 17:42:14.657383 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:42:14.657350    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a6d03b_dca9_4f0a_99e8_f297f083b529.slice/crio-bc91d7aa5501fd863badd36f60da7b80acec61d44f1fc32376d7607a00c5e384 WatchSource:0}: Error finding container bc91d7aa5501fd863badd36f60da7b80acec61d44f1fc32376d7607a00c5e384: Status 404 returned error can't find the container with id bc91d7aa5501fd863badd36f60da7b80acec61d44f1fc32376d7607a00c5e384
Jul 09 17:42:14.659562 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.659513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:14.759918 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.759887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:14.805606 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:14.805570    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch" event={"ID":"a3a6d03b-dca9-4f0a-99e8-f297f083b529","Type":"ContainerStarted","Data":"bc91d7aa5501fd863badd36f60da7b80acec61d44f1fc32376d7607a00c5e384"}
Jul 09 17:42:15.811362 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:15.811326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch" event={"ID":"a3a6d03b-dca9-4f0a-99e8-f297f083b529","Type":"ContainerStarted","Data":"636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3"}
Jul 09 17:42:15.811871 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:15.811425    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:15.829739 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:15.829672    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch" podStartSLOduration=1.463145352 podStartE2EDuration="1.829628484s" totalImagesPullingTime="366.483132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:42:15.82829662 +0000 UTC m=+2005.535509594" watchObservedRunningTime="2026-07-09 17:42:15.829628484 +0000 UTC m=+2005.536841430"
Jul 09 17:42:18.540918 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:18.540882    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:21.823026 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:21.822992    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:42:27.534000 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:27.533940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:27.637160 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:27.637104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:29.798832 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:29.798779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:36.379732 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:36.379682    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:36.480748 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:42:36.480713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:43:14.891593 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:43:14.891499    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:43:46.303070 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:43:46.303038    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:44:54.570958 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:44:54.570861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:00.145222 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.145191    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"]
Jul 09 17:45:00.148613 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.148594    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"
Jul 09 17:45:00.151146 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.151125    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vzm9h\""
Jul 09 17:45:00.151445 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.151432    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"]
Jul 09 17:45:00.154731 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.154708    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"]
Jul 09 17:45:00.154887 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.154855    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"
Jul 09 17:45:00.158003 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.157984    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"
Jul 09 17:45:00.159824 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.159800    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"
Jul 09 17:45:00.168176 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.168155    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"
Jul 09 17:45:00.171958 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.171931    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"]
Jul 09 17:45:00.188584 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.186700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"]
Jul 09 17:45:00.201449 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.201406    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"]
Jul 09 17:45:00.218293 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.218199    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"
Jul 09 17:45:00.338334 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.338300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"]
Jul 09 17:45:00.343216 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:45:00.343174    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6c382a_6e5e_4863_85ef_c2cd23f66f5d.slice/crio-6ddd146f9de9fc0c65acd04a6c5504838ac7b9225e8f43fa6656ae935c4a9355 WatchSource:0}: Error finding container 6ddd146f9de9fc0c65acd04a6c5504838ac7b9225e8f43fa6656ae935c4a9355: Status 404 returned error can't find the container with id 6ddd146f9de9fc0c65acd04a6c5504838ac7b9225e8f43fa6656ae935c4a9355
Jul 09 17:45:00.378163 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.378129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"]
Jul 09 17:45:00.381195 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:45:00.381168    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d390d4_8ea8_4955_ba33_97d88fca5651.slice/crio-0afd0612a6450976e9fa348962f04c7b35fc018ceefe3d4fb983035b4372dd78 WatchSource:0}: Error finding container 0afd0612a6450976e9fa348962f04c7b35fc018ceefe3d4fb983035b4372dd78: Status 404 returned error can't find the container with id 0afd0612a6450976e9fa348962f04c7b35fc018ceefe3d4fb983035b4372dd78
Jul 09 17:45:00.402185 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.402160    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"]
Jul 09 17:45:00.413961 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:45:00.413929    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa74b9f6_2361_4023_8b7e_60e3680e50bd.slice/crio-4dd64bb620fccd9b7fcc5278cf0715ef3db80bbdbb6b323c2066beb70c6405ed WatchSource:0}: Error finding container 4dd64bb620fccd9b7fcc5278cf0715ef3db80bbdbb6b323c2066beb70c6405ed: Status 404 returned error can't find the container with id 4dd64bb620fccd9b7fcc5278cf0715ef3db80bbdbb6b323c2066beb70c6405ed
Jul 09 17:45:00.589156 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.589117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28" event={"ID":"28d390d4-8ea8-4955-ba33-97d88fca5651","Type":"ContainerStarted","Data":"0afd0612a6450976e9fa348962f04c7b35fc018ceefe3d4fb983035b4372dd78"}
Jul 09 17:45:00.590302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.590264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx" event={"ID":"aa74b9f6-2361-4023-8b7e-60e3680e50bd","Type":"ContainerStarted","Data":"4dd64bb620fccd9b7fcc5278cf0715ef3db80bbdbb6b323c2066beb70c6405ed"}
Jul 09 17:45:00.591407 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:00.591384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx" event={"ID":"df6c382a-6e5e-4863-85ef-c2cd23f66f5d","Type":"ContainerStarted","Data":"6ddd146f9de9fc0c65acd04a6c5504838ac7b9225e8f43fa6656ae935c4a9355"}
Jul 09 17:45:01.597623 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:01.597584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28" event={"ID":"28d390d4-8ea8-4955-ba33-97d88fca5651","Type":"ContainerStarted","Data":"b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3"}
Jul 09 17:45:01.599167 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:01.599141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx" event={"ID":"aa74b9f6-2361-4023-8b7e-60e3680e50bd","Type":"ContainerStarted","Data":"655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749"}
Jul 09 17:45:01.600533 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:01.600511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx" event={"ID":"df6c382a-6e5e-4863-85ef-c2cd23f66f5d","Type":"ContainerStarted","Data":"5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09"}
Jul 09 17:45:01.616745 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:01.616693    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28" podStartSLOduration=1.6166746 podStartE2EDuration="1.6166746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:01.615531621 +0000 UTC m=+2171.322744591" watchObservedRunningTime="2026-07-09 17:45:01.6166746 +0000 UTC m=+2171.323887598"
Jul 09 17:45:01.631795 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:01.631722    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx" podStartSLOduration=1.63170471 podStartE2EDuration="1.63170471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:01.631454383 +0000 UTC m=+2171.338667330" watchObservedRunningTime="2026-07-09 17:45:01.63170471 +0000 UTC m=+2171.338917656"
Jul 09 17:45:01.655118 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:01.655058    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx" podStartSLOduration=1.655038861 podStartE2EDuration="1.655038861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:01.652200146 +0000 UTC m=+2171.359413107" watchObservedRunningTime="2026-07-09 17:45:01.655038861 +0000 UTC m=+2171.362251806"
Jul 09 17:45:17.575742 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:17.575698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:18.381127 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:18.381077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:26.875585 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.875544    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"]
Jul 09 17:45:26.878799 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.878776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:26.881480 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.881454    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77a679\"/\"kube-root-ca.crt\""
Jul 09 17:45:26.881621 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.881498    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77a679\"/\"openshift-service-ca.crt\""
Jul 09 17:45:26.882308 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.882292    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77a679\"/\"default-dockercfg-7zkwn\""
Jul 09 17:45:26.882398 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.882337    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77a679\"/\"sub-test-model-77a679-kserve-self-signed-certs\""
Jul 09 17:45:26.886271 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.886250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"]
Jul 09 17:45:26.897119 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.897091    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:26.961220 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.961182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-dshm\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:26.961220 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.961223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-home\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:26.961428 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.961256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-model-cache\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:26.961428 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.961315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-tmp-dir\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:26.961428 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.961355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnnss\" (UniqueName: \"kubernetes.io/projected/98e0b7bb-9aee-401d-a360-e68628107cc4-kube-api-access-cnnss\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:26.961428 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:26.961376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98e0b7bb-9aee-401d-a360-e68628107cc4-tls-certs\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.062443 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.062398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-model-cache\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.062443 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.062449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-tmp-dir\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.062715 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.062567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnnss\" (UniqueName: \"kubernetes.io/projected/98e0b7bb-9aee-401d-a360-e68628107cc4-kube-api-access-cnnss\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.062715 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.062605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98e0b7bb-9aee-401d-a360-e68628107cc4-tls-certs\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.062715 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.062684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-dshm\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.062715 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.062715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-home\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.062963 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.062863    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-tmp-dir\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.062963 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.062918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-model-cache\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.063065 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.063048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-home\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.065111 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.065068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-dshm\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.065341 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.065324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98e0b7bb-9aee-401d-a360-e68628107cc4-tls-certs\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.070898 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.070869    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnnss\" (UniqueName: \"kubernetes.io/projected/98e0b7bb-9aee-401d-a360-e68628107cc4-kube-api-access-cnnss\") pod \"sub-test-model-77a679-kserve-7d4dd674b9-v6spp\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") " pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.189699 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.189601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:27.347999 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.347971    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"]
Jul 09 17:45:27.350262 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:45:27.350226    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98e0b7bb_9aee_401d_a360_e68628107cc4.slice/crio-f61f1fa6d1284d20ba9b4e076bf4331536dd4ccd5cd9c99d84bd0fcac5cb5297 WatchSource:0}: Error finding container f61f1fa6d1284d20ba9b4e076bf4331536dd4ccd5cd9c99d84bd0fcac5cb5297: Status 404 returned error can't find the container with id f61f1fa6d1284d20ba9b4e076bf4331536dd4ccd5cd9c99d84bd0fcac5cb5297
Jul 09 17:45:27.734241 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.734196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp" event={"ID":"98e0b7bb-9aee-401d-a360-e68628107cc4","Type":"ContainerStarted","Data":"8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa"}
Jul 09 17:45:27.734440 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.734257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp" event={"ID":"98e0b7bb-9aee-401d-a360-e68628107cc4","Type":"ContainerStarted","Data":"f61f1fa6d1284d20ba9b4e076bf4331536dd4ccd5cd9c99d84bd0fcac5cb5297"}
Jul 09 17:45:27.750681 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:27.750617    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp" podStartSLOduration=1.750600784 podStartE2EDuration="1.750600784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:27.749162835 +0000 UTC m=+2197.456375782" watchObservedRunningTime="2026-07-09 17:45:27.750600784 +0000 UTC m=+2197.457813729"
Jul 09 17:45:37.190645 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:37.190601    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:37.190645 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:37.190654    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:37.203243 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:37.203212    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:37.796944 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:37.796907    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:45:54.404263 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:45:54.404224    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:00.010930 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:00.010891    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"]
Jul 09 17:46:00.011477 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:00.011103    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28" podUID="28d390d4-8ea8-4955-ba33-97d88fca5651" containerName="cleanup" containerID="cri-o://b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3" gracePeriod=30
Jul 09 17:46:00.014679 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:00.014649    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"]
Jul 09 17:46:00.014921 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:00.014899    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx" podUID="aa74b9f6-2361-4023-8b7e-60e3680e50bd" containerName="cleanup" containerID="cri-o://655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749" gracePeriod=30
Jul 09 17:46:00.016652 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:00.016628    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"]
Jul 09 17:46:00.016878 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:00.016842    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx" podUID="df6c382a-6e5e-4863-85ef-c2cd23f66f5d" containerName="cleanup" containerID="cri-o://5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09" gracePeriod=30
Jul 09 17:46:30.248108 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:30.248078    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"
Jul 09 17:46:30.252023 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:30.251989    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"
Jul 09 17:46:30.267111 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:30.267003    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"
Jul 09 17:46:31.038798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.038763    2579 generic.go:356] "Generic (PLEG): container finished" podID="28d390d4-8ea8-4955-ba33-97d88fca5651" containerID="b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3" exitCode=137
Jul 09 17:46:31.038798 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.038807    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"
Jul 09 17:46:31.039106 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.038845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28" event={"ID":"28d390d4-8ea8-4955-ba33-97d88fca5651","Type":"ContainerDied","Data":"b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3"}
Jul 09 17:46:31.039106 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.038904    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28" event={"ID":"28d390d4-8ea8-4955-ba33-97d88fca5651","Type":"ContainerDied","Data":"0afd0612a6450976e9fa348962f04c7b35fc018ceefe3d4fb983035b4372dd78"}
Jul 09 17:46:31.039106 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.038936    2579 scope.go:117] "RemoveContainer" containerID="b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3"
Jul 09 17:46:31.040402 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.040376    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa74b9f6-2361-4023-8b7e-60e3680e50bd" containerID="655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749" exitCode=137
Jul 09 17:46:31.040510 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.040430    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"
Jul 09 17:46:31.040510 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.040471    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx" event={"ID":"aa74b9f6-2361-4023-8b7e-60e3680e50bd","Type":"ContainerDied","Data":"655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749"}
Jul 09 17:46:31.040612 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.040517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx" event={"ID":"aa74b9f6-2361-4023-8b7e-60e3680e50bd","Type":"ContainerDied","Data":"4dd64bb620fccd9b7fcc5278cf0715ef3db80bbdbb6b323c2066beb70c6405ed"}
Jul 09 17:46:31.042053 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.042031    2579 generic.go:356] "Generic (PLEG): container finished" podID="df6c382a-6e5e-4863-85ef-c2cd23f66f5d" containerID="5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09" exitCode=137
Jul 09 17:46:31.042227 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.042080    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"
Jul 09 17:46:31.042227 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.042107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx" event={"ID":"df6c382a-6e5e-4863-85ef-c2cd23f66f5d","Type":"ContainerDied","Data":"5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09"}
Jul 09 17:46:31.042227 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.042145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx" event={"ID":"df6c382a-6e5e-4863-85ef-c2cd23f66f5d","Type":"ContainerDied","Data":"6ddd146f9de9fc0c65acd04a6c5504838ac7b9225e8f43fa6656ae935c4a9355"}
Jul 09 17:46:31.048650 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.048631    2579 scope.go:117] "RemoveContainer" containerID="b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3"
Jul 09 17:46:31.049028 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:46:31.049008    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3\": container with ID starting with b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3 not found: ID does not exist" containerID="b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3"
Jul 09 17:46:31.049113 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.049042    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3"} err="failed to get container status \"b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3\": rpc error: code = NotFound desc = could not find container \"b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3\": container with ID starting with b6283f4eea10614ff7d6a900e5d58cdb7188c577e0282ff56850e2144c7d57f3 not found: ID does not exist"
Jul 09 17:46:31.049113 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.049063    2579 scope.go:117] "RemoveContainer" containerID="655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749"
Jul 09 17:46:31.057500 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.057480    2579 scope.go:117] "RemoveContainer" containerID="655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749"
Jul 09 17:46:31.057800 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:46:31.057778    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749\": container with ID starting with 655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749 not found: ID does not exist" containerID="655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749"
Jul 09 17:46:31.057897 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.057808    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749"} err="failed to get container status \"655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749\": rpc error: code = NotFound desc = could not find container \"655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749\": container with ID starting with 655e4b33a123b8167b84ebc105bd5fe540889370dc82c86610cf51b5670e3749 not found: ID does not exist"
Jul 09 17:46:31.057897 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.057851    2579 scope.go:117] "RemoveContainer" containerID="5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09"
Jul 09 17:46:31.062941 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.062915    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"]
Jul 09 17:46:31.066952 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.066915    2579 scope.go:117] "RemoveContainer" containerID="5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09"
Jul 09 17:46:31.067293 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:46:31.067272    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09\": container with ID starting with 5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09 not found: ID does not exist" containerID="5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09"
Jul 09 17:46:31.067349 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.067305    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09"} err="failed to get container status \"5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09\": rpc error: code = NotFound desc = could not find container \"5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09\": container with ID starting with 5c74665028c5cd627741180832e939de4d17fd552f7ca0d32beed9fc20ea3a09 not found: ID does not exist"
Jul 09 17:46:31.068650 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.068631    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-qkq28"]
Jul 09 17:46:31.082349 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.082258    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"]
Jul 09 17:46:31.087736 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.087707    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77a679-29726985-m44cx"]
Jul 09 17:46:31.100529 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.100498    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"]
Jul 09 17:46:31.108961 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:31.103518    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f62372-29726985-6spkx"]
Jul 09 17:46:32.816009 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:32.815976    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28d390d4-8ea8-4955-ba33-97d88fca5651" path="/var/lib/kubelet/pods/28d390d4-8ea8-4955-ba33-97d88fca5651/volumes"
Jul 09 17:46:32.816412 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:32.816234    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa74b9f6-2361-4023-8b7e-60e3680e50bd" path="/var/lib/kubelet/pods/aa74b9f6-2361-4023-8b7e-60e3680e50bd/volumes"
Jul 09 17:46:32.816490 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:32.816475    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df6c382a-6e5e-4863-85ef-c2cd23f66f5d" path="/var/lib/kubelet/pods/df6c382a-6e5e-4863-85ef-c2cd23f66f5d/volumes"
Jul 09 17:46:37.456346 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:37.456309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:37.520317 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:37.520283    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"]
Jul 09 17:46:37.551535 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:37.551501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:38.581004 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:38.580966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:49.180762 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:49.180726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:52.540697 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.540650    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp" podUID="98e0b7bb-9aee-401d-a360-e68628107cc4" containerName="main" containerID="cri-o://8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa" gracePeriod=45
Jul 09 17:46:52.805691 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.805624    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:46:52.843167 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843134    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-home\") pod \"98e0b7bb-9aee-401d-a360-e68628107cc4\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") "
Jul 09 17:46:52.843375 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843178    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnnss\" (UniqueName: \"kubernetes.io/projected/98e0b7bb-9aee-401d-a360-e68628107cc4-kube-api-access-cnnss\") pod \"98e0b7bb-9aee-401d-a360-e68628107cc4\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") "
Jul 09 17:46:52.843375 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843227    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-model-cache\") pod \"98e0b7bb-9aee-401d-a360-e68628107cc4\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") "
Jul 09 17:46:52.843521 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843493    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-home" (OuterVolumeSpecName: "home") pod "98e0b7bb-9aee-401d-a360-e68628107cc4" (UID: "98e0b7bb-9aee-401d-a360-e68628107cc4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:46:52.843521 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843506    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-model-cache" (OuterVolumeSpecName: "model-cache") pod "98e0b7bb-9aee-401d-a360-e68628107cc4" (UID: "98e0b7bb-9aee-401d-a360-e68628107cc4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:46:52.843622 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843569    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-tmp-dir\") pod \"98e0b7bb-9aee-401d-a360-e68628107cc4\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") "
Jul 09 17:46:52.843706 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843689    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98e0b7bb-9aee-401d-a360-e68628107cc4-tls-certs\") pod \"98e0b7bb-9aee-401d-a360-e68628107cc4\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") "
Jul 09 17:46:52.843784 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-dshm\") pod \"98e0b7bb-9aee-401d-a360-e68628107cc4\" (UID: \"98e0b7bb-9aee-401d-a360-e68628107cc4\") "
Jul 09 17:46:52.843865 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.843785    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "98e0b7bb-9aee-401d-a360-e68628107cc4" (UID: "98e0b7bb-9aee-401d-a360-e68628107cc4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:46:52.844127 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.844064    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-home\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:46:52.844127 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.844088    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-model-cache\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:46:52.844127 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.844104    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-tmp-dir\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:46:52.845674 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.845644    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e0b7bb-9aee-401d-a360-e68628107cc4-kube-api-access-cnnss" (OuterVolumeSpecName: "kube-api-access-cnnss") pod "98e0b7bb-9aee-401d-a360-e68628107cc4" (UID: "98e0b7bb-9aee-401d-a360-e68628107cc4"). InnerVolumeSpecName "kube-api-access-cnnss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:46:52.845783 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.845763    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e0b7bb-9aee-401d-a360-e68628107cc4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "98e0b7bb-9aee-401d-a360-e68628107cc4" (UID: "98e0b7bb-9aee-401d-a360-e68628107cc4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:46:52.846073 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.846053    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-dshm" (OuterVolumeSpecName: "dshm") pod "98e0b7bb-9aee-401d-a360-e68628107cc4" (UID: "98e0b7bb-9aee-401d-a360-e68628107cc4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:46:52.944901 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.944860    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98e0b7bb-9aee-401d-a360-e68628107cc4-tls-certs\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:46:52.944901 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.944894    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98e0b7bb-9aee-401d-a360-e68628107cc4-dshm\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:46:52.944901 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:52.944907    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnnss\" (UniqueName: \"kubernetes.io/projected/98e0b7bb-9aee-401d-a360-e68628107cc4-kube-api-access-cnnss\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:46:53.155008 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.154908    2579 generic.go:356] "Generic (PLEG): container finished" podID="98e0b7bb-9aee-401d-a360-e68628107cc4" containerID="8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa" exitCode=0
Jul 09 17:46:53.155008 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.154959    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"
Jul 09 17:46:53.155008 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.154972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp" event={"ID":"98e0b7bb-9aee-401d-a360-e68628107cc4","Type":"ContainerDied","Data":"8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa"}
Jul 09 17:46:53.155275 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.155012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp" event={"ID":"98e0b7bb-9aee-401d-a360-e68628107cc4","Type":"ContainerDied","Data":"f61f1fa6d1284d20ba9b4e076bf4331536dd4ccd5cd9c99d84bd0fcac5cb5297"}
Jul 09 17:46:53.155275 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.155035    2579 scope.go:117] "RemoveContainer" containerID="8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa"
Jul 09 17:46:53.164797 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.164779    2579 scope.go:117] "RemoveContainer" containerID="8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa"
Jul 09 17:46:53.165167 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:46:53.165143    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa\": container with ID starting with 8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa not found: ID does not exist" containerID="8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa"
Jul 09 17:46:53.165324 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.165174    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa"} err="failed to get container status \"8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa\": rpc error: code = NotFound desc = could not find container \"8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa\": container with ID starting with 8fae6feab9962d7df8696fb1b0c376322b915ec9d42b8aa8b1e0b6500261d7aa not found: ID does not exist"
Jul 09 17:46:53.180682 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.180644    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"]
Jul 09 17:46:53.183896 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:53.183864    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-77a679/sub-test-model-77a679-kserve-7d4dd674b9-v6spp"]
Jul 09 17:46:54.815806 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:46:54.815769    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e0b7bb-9aee-401d-a360-e68628107cc4" path="/var/lib/kubelet/pods/98e0b7bb-9aee-401d-a360-e68628107cc4/volumes"
Jul 09 17:47:08.305426 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:08.305390    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:08.405923 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:08.405876    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:11.613534 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.613496    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"]
Jul 09 17:47:11.614105 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614084    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e0b7bb-9aee-401d-a360-e68628107cc4" containerName="main"
Jul 09 17:47:11.614194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614108    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e0b7bb-9aee-401d-a360-e68628107cc4" containerName="main"
Jul 09 17:47:11.614194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614125    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df6c382a-6e5e-4863-85ef-c2cd23f66f5d" containerName="cleanup"
Jul 09 17:47:11.614194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614134    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df6c382a-6e5e-4863-85ef-c2cd23f66f5d" containerName="cleanup"
Jul 09 17:47:11.614194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614144    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa74b9f6-2361-4023-8b7e-60e3680e50bd" containerName="cleanup"
Jul 09 17:47:11.614194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614152    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa74b9f6-2361-4023-8b7e-60e3680e50bd" containerName="cleanup"
Jul 09 17:47:11.614194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614165    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28d390d4-8ea8-4955-ba33-97d88fca5651" containerName="cleanup"
Jul 09 17:47:11.614194 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614175    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="28d390d4-8ea8-4955-ba33-97d88fca5651" containerName="cleanup"
Jul 09 17:47:11.614532 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614257    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e0b7bb-9aee-401d-a360-e68628107cc4" containerName="main"
Jul 09 17:47:11.614532 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614274    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="df6c382a-6e5e-4863-85ef-c2cd23f66f5d" containerName="cleanup"
Jul 09 17:47:11.614532 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614282    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa74b9f6-2361-4023-8b7e-60e3680e50bd" containerName="cleanup"
Jul 09 17:47:11.614532 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.614293    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="28d390d4-8ea8-4955-ba33-97d88fca5651" containerName="cleanup"
Jul 09 17:47:11.617320 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.617298    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.621401 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.621375    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f62372\"/\"default-dockercfg-2grt8\""
Jul 09 17:47:11.621724 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.621701    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f62372\"/\"openshift-service-ca.crt\""
Jul 09 17:47:11.622110 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.621703    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f62372\"/\"rate-test-model-f62372-kserve-self-signed-certs\""
Jul 09 17:47:11.622110 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.621785    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f62372\"/\"kube-root-ca.crt\""
Jul 09 17:47:11.637720 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.637682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"]
Jul 09 17:47:11.670286 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.670255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:11.717465 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.717431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grjm4\" (UniqueName: \"kubernetes.io/projected/e4b1c237-41fc-4c89-8597-b5aef1279eae-kube-api-access-grjm4\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.717650 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.717473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-home\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.717650 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.717505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b1c237-41fc-4c89-8597-b5aef1279eae-tls-certs\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.717650 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.717566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-model-cache\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.717650 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.717592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-dshm\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.717650 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.717611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-tmp-dir\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.818693 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.818657    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grjm4\" (UniqueName: \"kubernetes.io/projected/e4b1c237-41fc-4c89-8597-b5aef1279eae-kube-api-access-grjm4\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.818693 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.818697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-home\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.818972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.818729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b1c237-41fc-4c89-8597-b5aef1279eae-tls-certs\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.818972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.818769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-model-cache\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.818972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.818799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-dshm\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.818972 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.818853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-tmp-dir\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.819216 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.819185    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-home\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.819338 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.819315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-model-cache\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.819427 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.819402    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-tmp-dir\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.822051 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.821952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-dshm\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.822445 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.822425    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b1c237-41fc-4c89-8597-b5aef1279eae-tls-certs\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.828169 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.828137    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grjm4\" (UniqueName: \"kubernetes.io/projected/e4b1c237-41fc-4c89-8597-b5aef1279eae-kube-api-access-grjm4\") pod \"rate-test-model-f62372-kserve-5f5dc7c659-xw2d4\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") " pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:11.927245 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:11.927152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:12.069182 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:12.069071    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"]
Jul 09 17:47:12.071921 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:47:12.071885    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4b1c237_41fc_4c89_8597_b5aef1279eae.slice/crio-592351bce2bd56f1c6d084a149aae3a04c9cd0ffe57e04a9cbfe0f4b0a4eadd9 WatchSource:0}: Error finding container 592351bce2bd56f1c6d084a149aae3a04c9cd0ffe57e04a9cbfe0f4b0a4eadd9: Status 404 returned error can't find the container with id 592351bce2bd56f1c6d084a149aae3a04c9cd0ffe57e04a9cbfe0f4b0a4eadd9
Jul 09 17:47:12.245424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:12.245377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4" event={"ID":"e4b1c237-41fc-4c89-8597-b5aef1279eae","Type":"ContainerStarted","Data":"d762a4b785e1d752b3c50f94cfa2e11b4f81d7fcf8812f52b154d3b7b240ddcf"}
Jul 09 17:47:12.245424 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:12.245430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4" event={"ID":"e4b1c237-41fc-4c89-8597-b5aef1279eae","Type":"ContainerStarted","Data":"592351bce2bd56f1c6d084a149aae3a04c9cd0ffe57e04a9cbfe0f4b0a4eadd9"}
Jul 09 17:47:12.281503 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:12.281444    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4" podStartSLOduration=1.28142662 podStartE2EDuration="1.28142662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:47:12.28007045 +0000 UTC m=+2301.987283393" watchObservedRunningTime="2026-07-09 17:47:12.28142662 +0000 UTC m=+2301.988639565"
Jul 09 17:47:20.656516 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:20.656479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:20.731868 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:20.731837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:21.927988 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:21.927946    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:21.928502 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:21.928015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:21.940958 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:21.940927    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:22.301456 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:22.301426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:47:28.285986 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:28.285931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:28.386499 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:28.386464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:37.082640 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:37.082599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:37.191718 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:37.191681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:41.169130 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:41.169085    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:57.357143 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:57.357096    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:58.288290 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:58.288250    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"]
Jul 09 17:47:58.451782 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:58.451743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:59.275541 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.275501    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7492-140675926289456"]
Jul 09 17:47:59.278897 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.278880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675926289456"
Jul 09 17:47:59.281460 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.281436    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-4lqnx\""
Jul 09 17:47:59.284690 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.284665    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7492-140675926289456"]
Jul 09 17:47:59.359198 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.359153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6wd9\" (UniqueName: \"kubernetes.io/projected/1aaf1533-eaa5-47f1-9790-71e90f2b96ad-kube-api-access-h6wd9\") pod \"test-curl-7492-140675926289456\" (UID: \"1aaf1533-eaa5-47f1-9790-71e90f2b96ad\") " pod="openshift-ingress/test-curl-7492-140675926289456"
Jul 09 17:47:59.460610 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.460546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6wd9\" (UniqueName: \"kubernetes.io/projected/1aaf1533-eaa5-47f1-9790-71e90f2b96ad-kube-api-access-h6wd9\") pod \"test-curl-7492-140675926289456\" (UID: \"1aaf1533-eaa5-47f1-9790-71e90f2b96ad\") " pod="openshift-ingress/test-curl-7492-140675926289456"
Jul 09 17:47:59.469263 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.469230    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6wd9\" (UniqueName: \"kubernetes.io/projected/1aaf1533-eaa5-47f1-9790-71e90f2b96ad-kube-api-access-h6wd9\") pod \"test-curl-7492-140675926289456\" (UID: \"1aaf1533-eaa5-47f1-9790-71e90f2b96ad\") " pod="openshift-ingress/test-curl-7492-140675926289456"
Jul 09 17:47:59.590254 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.590153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675926289456"
Jul 09 17:47:59.727613 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.727581    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7492-140675926289456"]
Jul 09 17:47:59.730068 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:47:59.730034    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1aaf1533_eaa5_47f1_9790_71e90f2b96ad.slice/crio-ebad834f4360d2236f6212a43c5a08640a3594711d5b7bc236af7ca9aa79cf91 WatchSource:0}: Error finding container ebad834f4360d2236f6212a43c5a08640a3594711d5b7bc236af7ca9aa79cf91: Status 404 returned error can't find the container with id ebad834f4360d2236f6212a43c5a08640a3594711d5b7bc236af7ca9aa79cf91
Jul 09 17:47:59.731425 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:47:59.731408    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:48:00.474454 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:00.474420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7492-140675926289456" event={"ID":"1aaf1533-eaa5-47f1-9790-71e90f2b96ad","Type":"ContainerStarted","Data":"ebad834f4360d2236f6212a43c5a08640a3594711d5b7bc236af7ca9aa79cf91"}
Jul 09 17:48:01.480998 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:01.480963    2579 generic.go:356] "Generic (PLEG): container finished" podID="1aaf1533-eaa5-47f1-9790-71e90f2b96ad" containerID="0f55f7949597e76c0dc9d8fd8e516cb1d2ded4f6f2b5bfcae863f73adfe71b87" exitCode=0
Jul 09 17:48:01.481404 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:01.481013    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7492-140675926289456" event={"ID":"1aaf1533-eaa5-47f1-9790-71e90f2b96ad","Type":"ContainerDied","Data":"0f55f7949597e76c0dc9d8fd8e516cb1d2ded4f6f2b5bfcae863f73adfe71b87"}
Jul 09 17:48:02.638527 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.638498    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675926289456"
Jul 09 17:48:02.661830 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.661791    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7492-140675926289456_1aaf1533-eaa5-47f1-9790-71e90f2b96ad/test-curl-7492-140675926289456/0.log"
Jul 09 17:48:02.688841 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.688797    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7492-140675926289456"]
Jul 09 17:48:02.692837 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.692794    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7492-140675926289456"]
Jul 09 17:48:02.786483 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.786454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6wd9\" (UniqueName: \"kubernetes.io/projected/1aaf1533-eaa5-47f1-9790-71e90f2b96ad-kube-api-access-h6wd9\") pod \"1aaf1533-eaa5-47f1-9790-71e90f2b96ad\" (UID: \"1aaf1533-eaa5-47f1-9790-71e90f2b96ad\") "
Jul 09 17:48:02.788583 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.788554    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aaf1533-eaa5-47f1-9790-71e90f2b96ad-kube-api-access-h6wd9" (OuterVolumeSpecName: "kube-api-access-h6wd9") pod "1aaf1533-eaa5-47f1-9790-71e90f2b96ad" (UID: "1aaf1533-eaa5-47f1-9790-71e90f2b96ad"). InnerVolumeSpecName "kube-api-access-h6wd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:02.815675 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.815640    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aaf1533-eaa5-47f1-9790-71e90f2b96ad" path="/var/lib/kubelet/pods/1aaf1533-eaa5-47f1-9790-71e90f2b96ad/volumes"
Jul 09 17:48:02.816020 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.816006    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7492-140675926287280"]
Jul 09 17:48:02.816343 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.816329    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aaf1533-eaa5-47f1-9790-71e90f2b96ad" containerName="test-curl-7492-140675926289456"
Jul 09 17:48:02.816343 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.816343    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aaf1533-eaa5-47f1-9790-71e90f2b96ad" containerName="test-curl-7492-140675926289456"
Jul 09 17:48:02.816435 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.816405    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aaf1533-eaa5-47f1-9790-71e90f2b96ad" containerName="test-curl-7492-140675926289456"
Jul 09 17:48:02.819570 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.819551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675926287280"
Jul 09 17:48:02.823032 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.823005    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7492-140675926287280"]
Jul 09 17:48:02.887390 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.887355    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6wd9\" (UniqueName: \"kubernetes.io/projected/1aaf1533-eaa5-47f1-9790-71e90f2b96ad-kube-api-access-h6wd9\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:02.988020 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:02.987982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp9vn\" (UniqueName: \"kubernetes.io/projected/9df9b993-e411-4f5e-80ff-710927bab953-kube-api-access-gp9vn\") pod \"test-curl-7492-140675926287280\" (UID: \"9df9b993-e411-4f5e-80ff-710927bab953\") " pod="openshift-ingress/test-curl-7492-140675926287280"
Jul 09 17:48:03.089043 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:03.088940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp9vn\" (UniqueName: \"kubernetes.io/projected/9df9b993-e411-4f5e-80ff-710927bab953-kube-api-access-gp9vn\") pod \"test-curl-7492-140675926287280\" (UID: \"9df9b993-e411-4f5e-80ff-710927bab953\") " pod="openshift-ingress/test-curl-7492-140675926287280"
Jul 09 17:48:03.098168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:03.098132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp9vn\" (UniqueName: \"kubernetes.io/projected/9df9b993-e411-4f5e-80ff-710927bab953-kube-api-access-gp9vn\") pod \"test-curl-7492-140675926287280\" (UID: \"9df9b993-e411-4f5e-80ff-710927bab953\") " pod="openshift-ingress/test-curl-7492-140675926287280"
Jul 09 17:48:03.133263 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:03.133229    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675926287280"
Jul 09 17:48:03.279476 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:03.279446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7492-140675926287280"]
Jul 09 17:48:03.281301 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:48:03.281274    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9df9b993_e411_4f5e_80ff_710927bab953.slice/crio-9785c4a5f5e15f348d0f811bf5c4c5db19bb49d5e900f62d2a2d3209b0c791cc WatchSource:0}: Error finding container 9785c4a5f5e15f348d0f811bf5c4c5db19bb49d5e900f62d2a2d3209b0c791cc: Status 404 returned error can't find the container with id 9785c4a5f5e15f348d0f811bf5c4c5db19bb49d5e900f62d2a2d3209b0c791cc
Jul 09 17:48:03.492132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:03.492096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7492-140675926287280" event={"ID":"9df9b993-e411-4f5e-80ff-710927bab953","Type":"ContainerStarted","Data":"9785c4a5f5e15f348d0f811bf5c4c5db19bb49d5e900f62d2a2d3209b0c791cc"}
Jul 09 17:48:03.493322 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:03.493304    2579 scope.go:117] "RemoveContainer" containerID="0f55f7949597e76c0dc9d8fd8e516cb1d2ded4f6f2b5bfcae863f73adfe71b87"
Jul 09 17:48:03.493425 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:03.493310    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675926289456"
Jul 09 17:48:04.500533 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:04.500494    2579 generic.go:356] "Generic (PLEG): container finished" podID="9df9b993-e411-4f5e-80ff-710927bab953" containerID="2224d8aec65050f61930dd2fd71ea077fe55a4f915c57e09e1bf3039cdd71e05" exitCode=0
Jul 09 17:48:04.500998 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:04.500551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7492-140675926287280" event={"ID":"9df9b993-e411-4f5e-80ff-710927bab953","Type":"ContainerDied","Data":"2224d8aec65050f61930dd2fd71ea077fe55a4f915c57e09e1bf3039cdd71e05"}
Jul 09 17:48:05.662279 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:05.662253    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675926287280"
Jul 09 17:48:05.687728 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:05.687701    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7492-140675926287280_9df9b993-e411-4f5e-80ff-710927bab953/test-curl-7492-140675926287280/0.log"
Jul 09 17:48:05.714059 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:05.714017    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7492-140675926287280"]
Jul 09 17:48:05.716168 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:05.716138    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7492-140675926287280"]
Jul 09 17:48:05.814018 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:05.813925    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp9vn\" (UniqueName: \"kubernetes.io/projected/9df9b993-e411-4f5e-80ff-710927bab953-kube-api-access-gp9vn\") pod \"9df9b993-e411-4f5e-80ff-710927bab953\" (UID: \"9df9b993-e411-4f5e-80ff-710927bab953\") "
Jul 09 17:48:05.816130 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:05.816095    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df9b993-e411-4f5e-80ff-710927bab953-kube-api-access-gp9vn" (OuterVolumeSpecName: "kube-api-access-gp9vn") pod "9df9b993-e411-4f5e-80ff-710927bab953" (UID: "9df9b993-e411-4f5e-80ff-710927bab953"). InnerVolumeSpecName "kube-api-access-gp9vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:05.914838 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:05.914757    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp9vn\" (UniqueName: \"kubernetes.io/projected/9df9b993-e411-4f5e-80ff-710927bab953-kube-api-access-gp9vn\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:06.511302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:06.511269    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9785c4a5f5e15f348d0f811bf5c4c5db19bb49d5e900f62d2a2d3209b0c791cc"
Jul 09 17:48:06.511302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:06.511293    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675926287280"
Jul 09 17:48:06.521267 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:48:06.521232    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7492-140675926287280\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="9df9b993-e411-4f5e-80ff-710927bab953" pod="openshift-ingress/test-curl-7492-140675926287280"
Jul 09 17:48:06.816779 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:06.816697    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df9b993-e411-4f5e-80ff-710927bab953" path="/var/lib/kubelet/pods/9df9b993-e411-4f5e-80ff-710927bab953/volumes"
Jul 09 17:48:09.323320 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.323281    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7492-140675928385408"]
Jul 09 17:48:09.323891 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.323871    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df9b993-e411-4f5e-80ff-710927bab953" containerName="test-curl-7492-140675926287280"
Jul 09 17:48:09.323949 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.323894    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df9b993-e411-4f5e-80ff-710927bab953" containerName="test-curl-7492-140675926287280"
Jul 09 17:48:09.324020 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.324009    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df9b993-e411-4f5e-80ff-710927bab953" containerName="test-curl-7492-140675926287280"
Jul 09 17:48:09.327562 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.327539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675928385408"
Jul 09 17:48:09.330109 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.330084    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-4lqnx\""
Jul 09 17:48:09.333079 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.333052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7492-140675928385408"]
Jul 09 17:48:09.447385 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.447342    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4w4p\" (UniqueName: \"kubernetes.io/projected/b9815179-4c2a-4cde-a250-766275bcb007-kube-api-access-p4w4p\") pod \"test-curl-7492-140675928385408\" (UID: \"b9815179-4c2a-4cde-a250-766275bcb007\") " pod="openshift-ingress/test-curl-7492-140675928385408"
Jul 09 17:48:09.547970 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.547914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4w4p\" (UniqueName: \"kubernetes.io/projected/b9815179-4c2a-4cde-a250-766275bcb007-kube-api-access-p4w4p\") pod \"test-curl-7492-140675928385408\" (UID: \"b9815179-4c2a-4cde-a250-766275bcb007\") " pod="openshift-ingress/test-curl-7492-140675928385408"
Jul 09 17:48:09.556737 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.556699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4w4p\" (UniqueName: \"kubernetes.io/projected/b9815179-4c2a-4cde-a250-766275bcb007-kube-api-access-p4w4p\") pod \"test-curl-7492-140675928385408\" (UID: \"b9815179-4c2a-4cde-a250-766275bcb007\") " pod="openshift-ingress/test-curl-7492-140675928385408"
Jul 09 17:48:09.638695 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.638605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675928385408"
Jul 09 17:48:09.782248 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:09.782221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7492-140675928385408"]
Jul 09 17:48:09.785083 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:48:09.785055    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9815179_4c2a_4cde_a250_766275bcb007.slice/crio-a969f12c424c265f4d50c7eef9f096eabf31c2410947d2b85624605c1572e2f1 WatchSource:0}: Error finding container a969f12c424c265f4d50c7eef9f096eabf31c2410947d2b85624605c1572e2f1: Status 404 returned error can't find the container with id a969f12c424c265f4d50c7eef9f096eabf31c2410947d2b85624605c1572e2f1
Jul 09 17:48:10.533270 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:10.533233    2579 generic.go:356] "Generic (PLEG): container finished" podID="b9815179-4c2a-4cde-a250-766275bcb007" containerID="441e33bef7abf9c1e1007709b4982493fc227139cd4012c6cc84ec4fe4bab347" exitCode=0
Jul 09 17:48:10.533698 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:10.533327    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7492-140675928385408" event={"ID":"b9815179-4c2a-4cde-a250-766275bcb007","Type":"ContainerDied","Data":"441e33bef7abf9c1e1007709b4982493fc227139cd4012c6cc84ec4fe4bab347"}
Jul 09 17:48:10.533698 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:10.533377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7492-140675928385408" event={"ID":"b9815179-4c2a-4cde-a250-766275bcb007","Type":"ContainerStarted","Data":"a969f12c424c265f4d50c7eef9f096eabf31c2410947d2b85624605c1572e2f1"}
Jul 09 17:48:11.698162 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.698134    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675928385408"
Jul 09 17:48:11.721649 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.721618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7492-140675928385408_b9815179-4c2a-4cde-a250-766275bcb007/test-curl-7492-140675928385408/0.log"
Jul 09 17:48:11.748944 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.748906    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7492-140675928385408"]
Jul 09 17:48:11.752682 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.752653    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7492-140675928385408"]
Jul 09 17:48:11.870453 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.870362    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4w4p\" (UniqueName: \"kubernetes.io/projected/b9815179-4c2a-4cde-a250-766275bcb007-kube-api-access-p4w4p\") pod \"b9815179-4c2a-4cde-a250-766275bcb007\" (UID: \"b9815179-4c2a-4cde-a250-766275bcb007\") "
Jul 09 17:48:11.872621 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.872582    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9815179-4c2a-4cde-a250-766275bcb007-kube-api-access-p4w4p" (OuterVolumeSpecName: "kube-api-access-p4w4p") pod "b9815179-4c2a-4cde-a250-766275bcb007" (UID: "b9815179-4c2a-4cde-a250-766275bcb007"). InnerVolumeSpecName "kube-api-access-p4w4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:11.880165 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.880137    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7492-140675928386416"]
Jul 09 17:48:11.880509 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.880497    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9815179-4c2a-4cde-a250-766275bcb007" containerName="test-curl-7492-140675928385408"
Jul 09 17:48:11.880562 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.880511    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9815179-4c2a-4cde-a250-766275bcb007" containerName="test-curl-7492-140675928385408"
Jul 09 17:48:11.880597 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.880575    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9815179-4c2a-4cde-a250-766275bcb007" containerName="test-curl-7492-140675928385408"
Jul 09 17:48:11.883600 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.883581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675928386416"
Jul 09 17:48:11.892346 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.892319    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7492-140675928386416"]
Jul 09 17:48:11.971091 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.971054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg8ng\" (UniqueName: \"kubernetes.io/projected/a522fc1a-6fc3-41c7-ab5b-9801c8390082-kube-api-access-fg8ng\") pod \"test-curl-7492-140675928386416\" (UID: \"a522fc1a-6fc3-41c7-ab5b-9801c8390082\") " pod="openshift-ingress/test-curl-7492-140675928386416"
Jul 09 17:48:11.971302 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:11.971257    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4w4p\" (UniqueName: \"kubernetes.io/projected/b9815179-4c2a-4cde-a250-766275bcb007-kube-api-access-p4w4p\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:12.072511 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:12.072474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg8ng\" (UniqueName: \"kubernetes.io/projected/a522fc1a-6fc3-41c7-ab5b-9801c8390082-kube-api-access-fg8ng\") pod \"test-curl-7492-140675928386416\" (UID: \"a522fc1a-6fc3-41c7-ab5b-9801c8390082\") " pod="openshift-ingress/test-curl-7492-140675928386416"
Jul 09 17:48:12.082078 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:12.082044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg8ng\" (UniqueName: \"kubernetes.io/projected/a522fc1a-6fc3-41c7-ab5b-9801c8390082-kube-api-access-fg8ng\") pod \"test-curl-7492-140675928386416\" (UID: \"a522fc1a-6fc3-41c7-ab5b-9801c8390082\") " pod="openshift-ingress/test-curl-7492-140675928386416"
Jul 09 17:48:12.193580 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:12.193480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675928386416"
Jul 09 17:48:12.341255 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:12.341222    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7492-140675928386416"]
Jul 09 17:48:12.343023 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:48:12.343002    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda522fc1a_6fc3_41c7_ab5b_9801c8390082.slice/crio-29cd9ac6ae5ebc961c5f73a79b6ee285fe07e30d2aae35832ac60ad885a40b9b WatchSource:0}: Error finding container 29cd9ac6ae5ebc961c5f73a79b6ee285fe07e30d2aae35832ac60ad885a40b9b: Status 404 returned error can't find the container with id 29cd9ac6ae5ebc961c5f73a79b6ee285fe07e30d2aae35832ac60ad885a40b9b
Jul 09 17:48:12.544119 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:12.544075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7492-140675928386416" event={"ID":"a522fc1a-6fc3-41c7-ab5b-9801c8390082","Type":"ContainerStarted","Data":"29cd9ac6ae5ebc961c5f73a79b6ee285fe07e30d2aae35832ac60ad885a40b9b"}
Jul 09 17:48:12.545354 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:12.545337    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675928385408"
Jul 09 17:48:12.545445 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:12.545361    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a969f12c424c265f4d50c7eef9f096eabf31c2410947d2b85624605c1572e2f1"
Jul 09 17:48:12.555895 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:48:12.555865    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7492-140675928385408\" is forbidden: User \"system:node:ip-10-0-133-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-241.ec2.internal' and this object" podUID="b9815179-4c2a-4cde-a250-766275bcb007" pod="openshift-ingress/test-curl-7492-140675928385408"
Jul 09 17:48:12.815478 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:12.815384    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9815179-4c2a-4cde-a250-766275bcb007" path="/var/lib/kubelet/pods/b9815179-4c2a-4cde-a250-766275bcb007/volumes"
Jul 09 17:48:13.308807 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.308738    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4" podUID="e4b1c237-41fc-4c89-8597-b5aef1279eae" containerName="main" containerID="cri-o://d762a4b785e1d752b3c50f94cfa2e11b4f81d7fcf8812f52b154d3b7b240ddcf" gracePeriod=45
Jul 09 17:48:13.552367 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.552327    2579 generic.go:356] "Generic (PLEG): container finished" podID="a522fc1a-6fc3-41c7-ab5b-9801c8390082" containerID="9c2733cc3532aa05011049e3c9ce0576b924846798c7135da33458e0de9d15c0" exitCode=0
Jul 09 17:48:13.552549 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.552407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7492-140675928386416" event={"ID":"a522fc1a-6fc3-41c7-ab5b-9801c8390082","Type":"ContainerDied","Data":"9c2733cc3532aa05011049e3c9ce0576b924846798c7135da33458e0de9d15c0"}
Jul 09 17:48:13.554181 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.554153    2579 generic.go:356] "Generic (PLEG): container finished" podID="e4b1c237-41fc-4c89-8597-b5aef1279eae" containerID="d762a4b785e1d752b3c50f94cfa2e11b4f81d7fcf8812f52b154d3b7b240ddcf" exitCode=0
Jul 09 17:48:13.554294 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.554230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4" event={"ID":"e4b1c237-41fc-4c89-8597-b5aef1279eae","Type":"ContainerDied","Data":"d762a4b785e1d752b3c50f94cfa2e11b4f81d7fcf8812f52b154d3b7b240ddcf"}
Jul 09 17:48:13.576640 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.576614    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:48:13.685743 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.685709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-home\") pod \"e4b1c237-41fc-4c89-8597-b5aef1279eae\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") "
Jul 09 17:48:13.685983 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.685767    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b1c237-41fc-4c89-8597-b5aef1279eae-tls-certs\") pod \"e4b1c237-41fc-4c89-8597-b5aef1279eae\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") "
Jul 09 17:48:13.685983 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.685824    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-model-cache\") pod \"e4b1c237-41fc-4c89-8597-b5aef1279eae\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") "
Jul 09 17:48:13.685983 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.685859    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-tmp-dir\") pod \"e4b1c237-41fc-4c89-8597-b5aef1279eae\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") "
Jul 09 17:48:13.686158 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.686016    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-home" (OuterVolumeSpecName: "home") pod "e4b1c237-41fc-4c89-8597-b5aef1279eae" (UID: "e4b1c237-41fc-4c89-8597-b5aef1279eae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:13.686158 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.686057    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grjm4\" (UniqueName: \"kubernetes.io/projected/e4b1c237-41fc-4c89-8597-b5aef1279eae-kube-api-access-grjm4\") pod \"e4b1c237-41fc-4c89-8597-b5aef1279eae\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") "
Jul 09 17:48:13.686158 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.686084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4b1c237-41fc-4c89-8597-b5aef1279eae" (UID: "e4b1c237-41fc-4c89-8597-b5aef1279eae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:13.686158 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.686085    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4b1c237-41fc-4c89-8597-b5aef1279eae" (UID: "e4b1c237-41fc-4c89-8597-b5aef1279eae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:13.686158 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.686107    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-dshm\") pod \"e4b1c237-41fc-4c89-8597-b5aef1279eae\" (UID: \"e4b1c237-41fc-4c89-8597-b5aef1279eae\") "
Jul 09 17:48:13.686412 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.686390    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-home\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:13.686412 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.686413    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-model-cache\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:13.686573 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.686427    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-tmp-dir\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:13.688215 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.688185    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4b1c237-41fc-4c89-8597-b5aef1279eae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4b1c237-41fc-4c89-8597-b5aef1279eae" (UID: "e4b1c237-41fc-4c89-8597-b5aef1279eae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:48:13.688334 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.688216    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-dshm" (OuterVolumeSpecName: "dshm") pod "e4b1c237-41fc-4c89-8597-b5aef1279eae" (UID: "e4b1c237-41fc-4c89-8597-b5aef1279eae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:13.688334 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.688265    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4b1c237-41fc-4c89-8597-b5aef1279eae-kube-api-access-grjm4" (OuterVolumeSpecName: "kube-api-access-grjm4") pod "e4b1c237-41fc-4c89-8597-b5aef1279eae" (UID: "e4b1c237-41fc-4c89-8597-b5aef1279eae"). InnerVolumeSpecName "kube-api-access-grjm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:13.786861 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.786798    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b1c237-41fc-4c89-8597-b5aef1279eae-dshm\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:13.786861 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.786855    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b1c237-41fc-4c89-8597-b5aef1279eae-tls-certs\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:13.786861 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:13.786868    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grjm4\" (UniqueName: \"kubernetes.io/projected/e4b1c237-41fc-4c89-8597-b5aef1279eae-kube-api-access-grjm4\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:14.560045 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.560016    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"
Jul 09 17:48:14.560542 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.560051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4" event={"ID":"e4b1c237-41fc-4c89-8597-b5aef1279eae","Type":"ContainerDied","Data":"592351bce2bd56f1c6d084a149aae3a04c9cd0ffe57e04a9cbfe0f4b0a4eadd9"}
Jul 09 17:48:14.560542 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.560106    2579 scope.go:117] "RemoveContainer" containerID="d762a4b785e1d752b3c50f94cfa2e11b4f81d7fcf8812f52b154d3b7b240ddcf"
Jul 09 17:48:14.581159 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.581128    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"]
Jul 09 17:48:14.585567 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.585537    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f62372/rate-test-model-f62372-kserve-5f5dc7c659-xw2d4"]
Jul 09 17:48:14.710382 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.710354    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675928386416"
Jul 09 17:48:14.731173 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.731141    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7492-140675928386416_a522fc1a-6fc3-41c7-ab5b-9801c8390082/test-curl-7492-140675928386416/0.log"
Jul 09 17:48:14.762046 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.762010    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7492-140675928386416"]
Jul 09 17:48:14.765763 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.765736    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7492-140675928386416"]
Jul 09 17:48:14.816089 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.816009    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4b1c237-41fc-4c89-8597-b5aef1279eae" path="/var/lib/kubelet/pods/e4b1c237-41fc-4c89-8597-b5aef1279eae/volumes"
Jul 09 17:48:14.898173 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.898134    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg8ng\" (UniqueName: \"kubernetes.io/projected/a522fc1a-6fc3-41c7-ab5b-9801c8390082-kube-api-access-fg8ng\") pod \"a522fc1a-6fc3-41c7-ab5b-9801c8390082\" (UID: \"a522fc1a-6fc3-41c7-ab5b-9801c8390082\") "
Jul 09 17:48:14.900323 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.900296    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a522fc1a-6fc3-41c7-ab5b-9801c8390082-kube-api-access-fg8ng" (OuterVolumeSpecName: "kube-api-access-fg8ng") pod "a522fc1a-6fc3-41c7-ab5b-9801c8390082" (UID: "a522fc1a-6fc3-41c7-ab5b-9801c8390082"). InnerVolumeSpecName "kube-api-access-fg8ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:14.999271 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:14.999223    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg8ng\" (UniqueName: \"kubernetes.io/projected/a522fc1a-6fc3-41c7-ab5b-9801c8390082-kube-api-access-fg8ng\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:15.566978 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:15.566948    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7492-140675928386416"
Jul 09 17:48:15.567472 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:15.566958    2579 scope.go:117] "RemoveContainer" containerID="9c2733cc3532aa05011049e3c9ce0576b924846798c7135da33458e0de9d15c0"
Jul 09 17:48:16.815950 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:16.815905    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a522fc1a-6fc3-41c7-ab5b-9801c8390082" path="/var/lib/kubelet/pods/a522fc1a-6fc3-41c7-ab5b-9801c8390082/volumes"
Jul 09 17:48:17.753710 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:17.753675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:18.163387 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.163298    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"]
Jul 09 17:48:18.163802 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.163538    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj" podUID="d8b3f3eb-976d-40ae-81da-18b0cc54919c" containerName="maas-api" containerID="cri-o://d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3" gracePeriod=30
Jul 09 17:48:18.424324 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.424247    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:48:18.428676 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.428645    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g5zp\" (UniqueName: \"kubernetes.io/projected/d8b3f3eb-976d-40ae-81da-18b0cc54919c-kube-api-access-2g5zp\") pod \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") "
Jul 09 17:48:18.428843 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.428700    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8b3f3eb-976d-40ae-81da-18b0cc54919c-maas-api-tls\") pod \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") "
Jul 09 17:48:18.428843 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.428800    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b3f3eb-976d-40ae-81da-18b0cc54919c-openshift-service-ca\") pod \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\" (UID: \"d8b3f3eb-976d-40ae-81da-18b0cc54919c\") "
Jul 09 17:48:18.429191 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.429165    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8b3f3eb-976d-40ae-81da-18b0cc54919c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d8b3f3eb-976d-40ae-81da-18b0cc54919c" (UID: "d8b3f3eb-976d-40ae-81da-18b0cc54919c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:48:18.430879 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.430856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b3f3eb-976d-40ae-81da-18b0cc54919c-kube-api-access-2g5zp" (OuterVolumeSpecName: "kube-api-access-2g5zp") pod "d8b3f3eb-976d-40ae-81da-18b0cc54919c" (UID: "d8b3f3eb-976d-40ae-81da-18b0cc54919c"). InnerVolumeSpecName "kube-api-access-2g5zp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:18.430965 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.430930    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b3f3eb-976d-40ae-81da-18b0cc54919c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d8b3f3eb-976d-40ae-81da-18b0cc54919c" (UID: "d8b3f3eb-976d-40ae-81da-18b0cc54919c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:48:18.501681 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.501646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:18.529976 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.529936    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8b3f3eb-976d-40ae-81da-18b0cc54919c-openshift-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:18.529976 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.529969    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g5zp\" (UniqueName: \"kubernetes.io/projected/d8b3f3eb-976d-40ae-81da-18b0cc54919c-kube-api-access-2g5zp\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:18.529976 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.529982    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8b3f3eb-976d-40ae-81da-18b0cc54919c-maas-api-tls\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:18.584484 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.584446    2579 generic.go:356] "Generic (PLEG): container finished" podID="d8b3f3eb-976d-40ae-81da-18b0cc54919c" containerID="d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3" exitCode=0
Jul 09 17:48:18.584692 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.584494    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"
Jul 09 17:48:18.584692 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.584530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj" event={"ID":"d8b3f3eb-976d-40ae-81da-18b0cc54919c","Type":"ContainerDied","Data":"d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3"}
Jul 09 17:48:18.584692 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.584597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj" event={"ID":"d8b3f3eb-976d-40ae-81da-18b0cc54919c","Type":"ContainerDied","Data":"9503c42ad7f5e2254242d3403964e762307968089b1b9761e4cfc084f0119b51"}
Jul 09 17:48:18.584692 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.584627    2579 scope.go:117] "RemoveContainer" containerID="d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3"
Jul 09 17:48:18.594332 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.594311    2579 scope.go:117] "RemoveContainer" containerID="d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3"
Jul 09 17:48:18.594670 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:48:18.594641    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3\": container with ID starting with d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3 not found: ID does not exist" containerID="d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3"
Jul 09 17:48:18.594770 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.594682    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3"} err="failed to get container status \"d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3\": rpc error: code = NotFound desc = could not find container \"d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3\": container with ID starting with d78e53ed0c98e27aacfcc649e54e3939e4d1ea3088131272298c588aa596ced3 not found: ID does not exist"
Jul 09 17:48:18.599868 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.599839    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:18.604453 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.604427    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"]
Jul 09 17:48:18.606519 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.606497    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77a679-5bbdfdd855-t24mj"]
Jul 09 17:48:18.815670 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:18.815633    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b3f3eb-976d-40ae-81da-18b0cc54919c" path="/var/lib/kubelet/pods/d8b3f3eb-976d-40ae-81da-18b0cc54919c/volumes"
Jul 09 17:48:23.854067 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:23.854035    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:23.917882 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:23.917853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:24.121527 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:24.121440    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:24.375499 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:24.375404    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:24.525243 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:24.525211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:24.952627 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:24.952596    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:25.092061 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.092025    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:25.198161 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.198122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:25.340144 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.340100    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"]
Jul 09 17:48:25.340415 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.340367    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch" podUID="a3a6d03b-dca9-4f0a-99e8-f297f083b529" containerName="maas-api" containerID="cri-o://636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3" gracePeriod=30
Jul 09 17:48:25.373923 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.373873    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:25.597095 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.597023    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:48:25.617644 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.617606    2579 generic.go:356] "Generic (PLEG): container finished" podID="a3a6d03b-dca9-4f0a-99e8-f297f083b529" containerID="636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3" exitCode=0
Jul 09 17:48:25.617867 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.617653    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"
Jul 09 17:48:25.617867 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.617693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch" event={"ID":"a3a6d03b-dca9-4f0a-99e8-f297f083b529","Type":"ContainerDied","Data":"636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3"}
Jul 09 17:48:25.617867 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.617759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch" event={"ID":"a3a6d03b-dca9-4f0a-99e8-f297f083b529","Type":"ContainerDied","Data":"bc91d7aa5501fd863badd36f60da7b80acec61d44f1fc32376d7607a00c5e384"}
Jul 09 17:48:25.617867 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.617790    2579 scope.go:117] "RemoveContainer" containerID="636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3"
Jul 09 17:48:25.626154 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.626134    2579 scope.go:117] "RemoveContainer" containerID="636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3"
Jul 09 17:48:25.626478 ip-10-0-133-241 kubenswrapper[2579]: E0709 17:48:25.626452    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3\": container with ID starting with 636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3 not found: ID does not exist" containerID="636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3"
Jul 09 17:48:25.626593 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.626486    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3"} err="failed to get container status \"636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3\": rpc error: code = NotFound desc = could not find container \"636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3\": container with ID starting with 636bef1e6071bca2e337f82ef4ba578022bc756a2d08a68999bba8694640d2f3 not found: ID does not exist"
Jul 09 17:48:25.692379 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.692337    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a6d03b-dca9-4f0a-99e8-f297f083b529-maas-api-tls\") pod \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") "
Jul 09 17:48:25.692580 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.692387    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtr2j\" (UniqueName: \"kubernetes.io/projected/a3a6d03b-dca9-4f0a-99e8-f297f083b529-kube-api-access-vtr2j\") pod \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") "
Jul 09 17:48:25.692580 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.692439    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a6d03b-dca9-4f0a-99e8-f297f083b529-openshift-service-ca\") pod \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\" (UID: \"a3a6d03b-dca9-4f0a-99e8-f297f083b529\") "
Jul 09 17:48:25.692802 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.692774    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3a6d03b-dca9-4f0a-99e8-f297f083b529-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3a6d03b-dca9-4f0a-99e8-f297f083b529" (UID: "a3a6d03b-dca9-4f0a-99e8-f297f083b529"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:48:25.694554 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.694527    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3a6d03b-dca9-4f0a-99e8-f297f083b529-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3a6d03b-dca9-4f0a-99e8-f297f083b529" (UID: "a3a6d03b-dca9-4f0a-99e8-f297f083b529"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:48:25.694661 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.694578    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a6d03b-dca9-4f0a-99e8-f297f083b529-kube-api-access-vtr2j" (OuterVolumeSpecName: "kube-api-access-vtr2j") pod "a3a6d03b-dca9-4f0a-99e8-f297f083b529" (UID: "a3a6d03b-dca9-4f0a-99e8-f297f083b529"). InnerVolumeSpecName "kube-api-access-vtr2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:25.793180 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.793141    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a6d03b-dca9-4f0a-99e8-f297f083b529-maas-api-tls\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:25.793180 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.793172    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtr2j\" (UniqueName: \"kubernetes.io/projected/a3a6d03b-dca9-4f0a-99e8-f297f083b529-kube-api-access-vtr2j\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:25.793180 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.793183    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a6d03b-dca9-4f0a-99e8-f297f083b529-openshift-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\""
Jul 09 17:48:25.942916 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.942880    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"]
Jul 09 17:48:25.946508 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:25.946480    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f62372-854877578c-m8wch"]
Jul 09 17:48:26.816878 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:26.816847    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3a6d03b-dca9-4f0a-99e8-f297f083b529" path="/var/lib/kubelet/pods/a3a6d03b-dca9-4f0a-99e8-f297f083b529/volumes"
Jul 09 17:48:30.912706 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:30.912665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:30.982128 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:30.982094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:31.191597 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:31.191508    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:31.425046 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:31.425014    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:33.489874 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:33.489838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:33.590866 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:33.590797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:36.705501 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:36.705467    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-65bdr_f214251f-1295-4b4d-b41b-37a7d077a9a3/manager/0.log"
Jul 09 17:48:36.829570 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:36.829540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4z4hm_14026ecb-4f12-4454-82b6-ed45de9a6626/manager/0.log"
Jul 09 17:48:36.954214 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:36.954170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79dbcf8674-6blp8_34783aaa-fc9e-45fa-b917-dd1cd84a9f63/manager/0.log"
Jul 09 17:48:37.081692 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:37.081668    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wzjfk_1861aee3-8b2c-44ee-9d35-b5587bacbaf9/server/0.log"
Jul 09 17:48:37.207074 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:37.207043    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2hpwk_c30baf0f-3601-4dba-aef3-ab8998759c7e/manager/0.log"
Jul 09 17:48:37.462408 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:37.462323    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849f76587-74tp2_e9e96c9a-d706-4ade-b924-72497dc24fda/manager/0.log"
Jul 09 17:48:37.468608 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:37.468586    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849f76587-74tp2_e9e96c9a-d706-4ade-b924-72497dc24fda/copy-manifests/0.log"
Jul 09 17:48:38.068291 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:38.068263    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-wzpwm_ce96d7b5-2e94-4b78-9d87-92d0d781d06e/postgres/0.log"
Jul 09 17:48:39.603767 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:39.603734    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wzb48_b5cdd00d-2e86-4f63-95a2-7d02ee31cf82/manager/0.log"
Jul 09 17:48:39.724114 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:39.724072    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ljwwq_81d9d454-dcf4-4179-b44b-876dd3b7546f/manager/0.log"
Jul 09 17:48:39.976866 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:39.976751    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-blrdj_6dfc26aa-5607-4e3d-9b3e-969103d2b40a/registry-server/0.log"
Jul 09 17:48:40.106315 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:40.106284    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mftxx_25952548-141a-4803-954b-2798bff9426f/manager/0.log"
Jul 09 17:48:40.361637 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:40.361607    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lfbr2_c6ae0d9e-0180-4a60-96b8-0db791e145f2/manager/0.log"
Jul 09 17:48:41.088718 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:41.088687    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cb4ccd4b-ndxwf_491f4d3c-0ea8-4231-a7ef-3233f82282b6/kube-auth-proxy/0.log"
Jul 09 17:48:41.341163 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:41.341061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-stbzf_7943560a-f856-4fd8-be9e-4acbd03e6c39/payload-pre-processing/0.log"
Jul 09 17:48:41.943163 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:41.943135    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-58xgw_0cbdf26c-55e1-4b3d-9e0c-5d97e5e13aa9/main/0.log"
Jul 09 17:48:42.169132 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:42.169104    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-58wtf_2e819617-372b-4b44-a31a-3ca9051c59d5/main/0.log"
Jul 09 17:48:42.410949 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:42.410921    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-vxv6k_f81ed3f5-612e-4b33-a74b-e4350c0ed1c5/main/0.log"
Jul 09 17:48:46.572330 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:46.572273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:46.670382 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:46.670347    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:49.313404 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:49.313378    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jt9kd_f54b4f19-62e8-4495-ae0e-a62f938f7436/global-pull-secret-syncer/0.log"
Jul 09 17:48:49.448218 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:49.448184    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2ms5r_9e8523e9-f782-472b-b6ee-72d2a2c2393a/konnectivity-agent/0.log"
Jul 09 17:48:49.540741 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:49.540713    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-241.ec2.internal_9589e3ff13c764f99fd24813eb6a730b/haproxy/0.log"
Jul 09 17:48:54.259829 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:54.259767    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wzb48_b5cdd00d-2e86-4f63-95a2-7d02ee31cf82/manager/0.log"
Jul 09 17:48:54.284920 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:54.284891    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ljwwq_81d9d454-dcf4-4179-b44b-876dd3b7546f/manager/0.log"
Jul 09 17:48:54.353364 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:54.353334    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-blrdj_6dfc26aa-5607-4e3d-9b3e-969103d2b40a/registry-server/0.log"
Jul 09 17:48:54.491630 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:54.491593    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mftxx_25952548-141a-4803-954b-2798bff9426f/manager/0.log"
Jul 09 17:48:54.599528 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:54.599432    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lfbr2_c6ae0d9e-0180-4a60-96b8-0db791e145f2/manager/0.log"
Jul 09 17:48:56.545299 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:56.545274    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmlct_4c135eef-f0b3-478c-bc54-bc29f60d7a45/node-exporter/0.log"
Jul 09 17:48:56.565733 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:56.565710    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmlct_4c135eef-f0b3-478c-bc54-bc29f60d7a45/kube-rbac-proxy/0.log"
Jul 09 17:48:56.588098 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:48:56.588066    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmlct_4c135eef-f0b3-478c-bc54-bc29f60d7a45/init-textfile/0.log"
Jul 09 17:49:00.170210 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170172    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"]
Jul 09 17:49:00.170752 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170731    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a522fc1a-6fc3-41c7-ab5b-9801c8390082" containerName="test-curl-7492-140675928386416"
Jul 09 17:49:00.170863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170756    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a522fc1a-6fc3-41c7-ab5b-9801c8390082" containerName="test-curl-7492-140675928386416"
Jul 09 17:49:00.170863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170782    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a6d03b-dca9-4f0a-99e8-f297f083b529" containerName="maas-api"
Jul 09 17:49:00.170863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170792    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a6d03b-dca9-4f0a-99e8-f297f083b529" containerName="maas-api"
Jul 09 17:49:00.170863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170806    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b1c237-41fc-4c89-8597-b5aef1279eae" containerName="main"
Jul 09 17:49:00.170863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170831    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b1c237-41fc-4c89-8597-b5aef1279eae" containerName="main"
Jul 09 17:49:00.170863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170847    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b3f3eb-976d-40ae-81da-18b0cc54919c" containerName="maas-api"
Jul 09 17:49:00.170863 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170856    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b3f3eb-976d-40ae-81da-18b0cc54919c" containerName="maas-api"
Jul 09 17:49:00.171241 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170977    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b3f3eb-976d-40ae-81da-18b0cc54919c" containerName="maas-api"
Jul 09 17:49:00.171241 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.170991    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4b1c237-41fc-4c89-8597-b5aef1279eae" containerName="main"
Jul 09 17:49:00.171241 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.171004    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a522fc1a-6fc3-41c7-ab5b-9801c8390082" containerName="test-curl-7492-140675928386416"
Jul 09 17:49:00.171241 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.171013    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a6d03b-dca9-4f0a-99e8-f297f083b529" containerName="maas-api"
Jul 09 17:49:00.173916 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.173895    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.176221 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.176199    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdggh\"/\"openshift-service-ca.crt\""
Jul 09 17:49:00.176364 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.176281    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdggh\"/\"kube-root-ca.crt\""
Jul 09 17:49:00.176923 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.176905    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gdggh\"/\"default-dockercfg-fngdp\""
Jul 09 17:49:00.183026 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.182997    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"]
Jul 09 17:49:00.302265 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.302225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-proc\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.302265 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.302270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-lib-modules\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.302512 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.302297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-sys\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.302512 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.302344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wg6n\" (UniqueName: \"kubernetes.io/projected/ba81ba97-162c-4289-87ac-0b4280ac20e5-kube-api-access-4wg6n\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.302512 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.302470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-podres\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403145 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-proc\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403145 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-lib-modules\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-sys\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wg6n\" (UniqueName: \"kubernetes.io/projected/ba81ba97-162c-4289-87ac-0b4280ac20e5-kube-api-access-4wg6n\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403230    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-proc\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-podres\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-sys\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-podres\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.403371 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.403343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba81ba97-162c-4289-87ac-0b4280ac20e5-lib-modules\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.410950 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.410918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wg6n\" (UniqueName: \"kubernetes.io/projected/ba81ba97-162c-4289-87ac-0b4280ac20e5-kube-api-access-4wg6n\") pod \"perf-node-gather-daemonset-dpw77\" (UID: \"ba81ba97-162c-4289-87ac-0b4280ac20e5\") " pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.484411 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.484307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.624009 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.623960    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"]
Jul 09 17:49:00.626277 ip-10-0-133-241 kubenswrapper[2579]: W0709 17:49:00.626245    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podba81ba97_162c_4289_87ac_0b4280ac20e5.slice/crio-26d680f064e79f568a13f045202a4c7062974c11c9af8a86773951002a133cb5 WatchSource:0}: Error finding container 26d680f064e79f568a13f045202a4c7062974c11c9af8a86773951002a133cb5: Status 404 returned error can't find the container with id 26d680f064e79f568a13f045202a4c7062974c11c9af8a86773951002a133cb5
Jul 09 17:49:00.787149 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.787112    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77" event={"ID":"ba81ba97-162c-4289-87ac-0b4280ac20e5","Type":"ContainerStarted","Data":"eeec2a743ddd189d8b095a6dd5dab10386fd63d4f8b6dbade6856ade4859a28b"}
Jul 09 17:49:00.787476 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.787166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77" event={"ID":"ba81ba97-162c-4289-87ac-0b4280ac20e5","Type":"ContainerStarted","Data":"26d680f064e79f568a13f045202a4c7062974c11c9af8a86773951002a133cb5"}
Jul 09 17:49:00.787476 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.787198    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:00.806367 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:00.806311    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77" podStartSLOduration=0.806295218 podStartE2EDuration="806.295218ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:49:00.804804327 +0000 UTC m=+2410.512017274" watchObservedRunningTime="2026-07-09 17:49:00.806295218 +0000 UTC m=+2410.513508214"
Jul 09 17:49:01.557506 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:01.557475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gb84w_60ac1954-aca3-4057-8b4b-40be4545d6ca/dns/0.log"
Jul 09 17:49:01.581378 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:01.581348    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gb84w_60ac1954-aca3-4057-8b4b-40be4545d6ca/kube-rbac-proxy/0.log"
Jul 09 17:49:01.762707 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:01.762682    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s7cpk_2562b30c-93aa-4784-8555-6db28c59b897/dns-node-resolver/0.log"
Jul 09 17:49:02.269500 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:02.269463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7899897b97-hgcw2_2747e923-bf69-4f1f-8e62-31796c4bf014/registry/0.log"
Jul 09 17:49:02.317035 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:02.317002    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n5ct4_fe4b4f51-3bfd-414d-b08a-1ec78f83c0fb/node-ca/0.log"
Jul 09 17:49:03.516303 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:03.516274    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cb4ccd4b-ndxwf_491f4d3c-0ea8-4231-a7ef-3233f82282b6/kube-auth-proxy/0.log"
Jul 09 17:49:03.636294 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:03.636262    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-stbzf_7943560a-f856-4fd8-be9e-4acbd03e6c39/payload-pre-processing/0.log"
Jul 09 17:49:04.375158 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:04.375126    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5jnqv_39c27eb5-ff3b-432e-99ea-98c723fdd12a/serve-healthcheck-canary/0.log"
Jul 09 17:49:05.051289 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:05.051253    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xmd4c_0399c2f6-c71b-4c2c-8205-dede07dbc90c/kube-rbac-proxy/0.log"
Jul 09 17:49:05.073025 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:05.072997    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xmd4c_0399c2f6-c71b-4c2c-8205-dede07dbc90c/exporter/0.log"
Jul 09 17:49:05.094908 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:05.094876    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xmd4c_0399c2f6-c71b-4c2c-8205-dede07dbc90c/extractor/0.log"
Jul 09 17:49:06.801944 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:06.801910    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gdggh/perf-node-gather-daemonset-dpw77"
Jul 09 17:49:07.134709 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:07.134618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-65bdr_f214251f-1295-4b4d-b41b-37a7d077a9a3/manager/0.log"
Jul 09 17:49:07.266832 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:07.266787    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4z4hm_14026ecb-4f12-4454-82b6-ed45de9a6626/manager/0.log"
Jul 09 17:49:07.362504 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:07.362470    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79dbcf8674-6blp8_34783aaa-fc9e-45fa-b917-dd1cd84a9f63/manager/0.log"
Jul 09 17:49:07.385105 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:07.385013    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wzjfk_1861aee3-8b2c-44ee-9d35-b5587bacbaf9/server/0.log"
Jul 09 17:49:07.458771 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:07.458739    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2hpwk_c30baf0f-3601-4dba-aef3-ab8998759c7e/manager/0.log"
Jul 09 17:49:07.539318 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:07.539289    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849f76587-74tp2_e9e96c9a-d706-4ade-b924-72497dc24fda/manager/0.log"
Jul 09 17:49:07.560180 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:07.560154    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849f76587-74tp2_e9e96c9a-d706-4ade-b924-72497dc24fda/copy-manifests/0.log"
Jul 09 17:49:10.224832 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:10.224725    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cb4ccd4b-ndxwf_491f4d3c-0ea8-4231-a7ef-3233f82282b6/kube-auth-proxy/0.log"
Jul 09 17:49:10.330560 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:10.330521    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-stbzf_7943560a-f856-4fd8-be9e-4acbd03e6c39/payload-pre-processing/0.log"
Jul 09 17:49:11.861702 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:11.861674    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cb4ccd4b-ndxwf_491f4d3c-0ea8-4231-a7ef-3233f82282b6/kube-auth-proxy/0.log"
Jul 09 17:49:11.968358 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:11.968264    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-stbzf_7943560a-f856-4fd8-be9e-4acbd03e6c39/payload-pre-processing/0.log"
Jul 09 17:49:15.867571 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:15.867322    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w62z5_e9737d5e-7c24-4e9c-8516-dd865fee4e56/kube-multus-additional-cni-plugins/0.log"
Jul 09 17:49:15.884008 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:15.883974    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w62z5_e9737d5e-7c24-4e9c-8516-dd865fee4e56/egress-router-binary-copy/0.log"
Jul 09 17:49:15.906575 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:15.906536    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w62z5_e9737d5e-7c24-4e9c-8516-dd865fee4e56/cni-plugins/0.log"
Jul 09 17:49:15.928509 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:15.928481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w62z5_e9737d5e-7c24-4e9c-8516-dd865fee4e56/bond-cni-plugin/0.log"
Jul 09 17:49:15.951096 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:15.951065    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w62z5_e9737d5e-7c24-4e9c-8516-dd865fee4e56/routeoverride-cni/0.log"
Jul 09 17:49:15.972988 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:15.972964    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w62z5_e9737d5e-7c24-4e9c-8516-dd865fee4e56/whereabouts-cni-bincopy/0.log"
Jul 09 17:49:15.996728 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:15.996701    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w62z5_e9737d5e-7c24-4e9c-8516-dd865fee4e56/whereabouts-cni/0.log"
Jul 09 17:49:16.032199 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:16.032168    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mdqhl_4d59db3b-ff13-4325-a439-52f95b3d560d/kube-multus/0.log"
Jul 09 17:49:16.132674 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:16.132590    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l28vt_c4557ec4-4b4f-41ec-9926-be1e9fb7948e/network-metrics-daemon/0.log"
Jul 09 17:49:16.152892 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:16.152851    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l28vt_c4557ec4-4b4f-41ec-9926-be1e9fb7948e/kube-rbac-proxy/0.log"
Jul 09 17:49:17.028096 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:17.028065    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76nj5_dd3869dd-ae6e-458e-ac82-6c601c2fc1bb/ovn-controller/0.log"
Jul 09 17:49:17.047789 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:17.047763    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76nj5_dd3869dd-ae6e-458e-ac82-6c601c2fc1bb/ovn-acl-logging/0.log"
Jul 09 17:49:17.073332 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:17.073303    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76nj5_dd3869dd-ae6e-458e-ac82-6c601c2fc1bb/kube-rbac-proxy-node/0.log"
Jul 09 17:49:17.111207 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:17.111178    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76nj5_dd3869dd-ae6e-458e-ac82-6c601c2fc1bb/kube-rbac-proxy-ovn-metrics/0.log"
Jul 09 17:49:17.133375 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:17.133345    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76nj5_dd3869dd-ae6e-458e-ac82-6c601c2fc1bb/northd/0.log"
Jul 09 17:49:17.156577 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:17.156553    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76nj5_dd3869dd-ae6e-458e-ac82-6c601c2fc1bb/nbdb/0.log"
Jul 09 17:49:17.185182 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:17.185148    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76nj5_dd3869dd-ae6e-458e-ac82-6c601c2fc1bb/sbdb/0.log"
Jul 09 17:49:17.243218 ip-10-0-133-241 kubenswrapper[2579]: I0709 17:49:17.243185    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76nj5_dd3869dd-ae6e-458e-ac82-6c601c2fc1bb/ovnkube-controller/0.log"