Jul 14 07:47:56.932980 ip-10-0-131-251 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 07:47:56.932993 ip-10-0-131-251 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 07:47:56.933000 ip-10-0-131-251 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 07:47:56.933256 ip-10-0-131-251 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 07:48:07.011977 ip-10-0-131-251 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 14 07:48:07.011999 ip-10-0-131-251 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2689109a329f4850b91d39f61dced191 --
Jul 14 07:50:04.314349 ip-10-0-131-251 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 07:50:04.703679 ip-10-0-131-251 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 07:50:04.703679 ip-10-0-131-251 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 07:50:04.703679 ip-10-0-131-251 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 07:50:04.703679 ip-10-0-131-251 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 07:50:04.703679 ip-10-0-131-251 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 07:50:04.704741 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.704643    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 07:50:04.709183 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709165    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:50:04.709183 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709184    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709188    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709192    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709195    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709198    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709201    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709205    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709208    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709211    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709214    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709218    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709222    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709225    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709228    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709232    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709236    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709239    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709243    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709246    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709249    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:50:04.709254 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709252    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709255    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709258    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709261    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709264    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709267    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709271    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709274    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709277    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709280    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709282    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709286    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709289    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709291    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709294    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709297    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709300    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709304    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709307    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709309    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:50:04.709784 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709312    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709315    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709318    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709321    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709324    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709326    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709329    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709334    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709338    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709341    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709344    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709347    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709349    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709352    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709358    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709362    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709366    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709369    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709373    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:50:04.710324 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709376    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709379    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709382    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709392    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709396    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709399    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709402    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709405    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709408    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709411    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709414    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709417    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709420    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709423    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709426    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709432    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709435    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709438    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709441    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709444    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:50:04.710859 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709447    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709450    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709452    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709455    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709458    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709461    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709464    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709467    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709471    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709474    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709477    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709479    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709482    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709486    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709488    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709491    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709494    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709497    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.709500    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710301    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:50:04.711381 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710308    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710311    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710314    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710318    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710321    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710324    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710327    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710330    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710334    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710337    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710341    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710344    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710347    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710352    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710356    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710360    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710363    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710366    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710369    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710374    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:50:04.711880 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710377    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710381    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710384    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710387    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710390    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710394    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710396    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710399    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710402    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710405    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710408    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710411    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710413    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710416    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710419    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710421    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710424    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710428    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710431    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:50:04.712421 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710433    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710436    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710439    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710442    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710445    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710448    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710451    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710453    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710456    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710459    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710462    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710465    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710469    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710472    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710475    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710477    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710480    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710483    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710486    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710488    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:50:04.712915 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710491    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710494    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710497    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710500    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710502    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710505    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710508    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710510    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710513    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710516    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710519    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710521    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710524    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710527    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710530    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710533    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710536    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710538    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710541    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710544    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:50:04.713454 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710549    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710553    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710556    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710560    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710565    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710569    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710572    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710575    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710578    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710581    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710584    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710587    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710589    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710592    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710595    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710598    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710601    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710604    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.710606    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:50:04.713998 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711004    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711010    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711013    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711016    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711019    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711022    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711024    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711028    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711041    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711044    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711047    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711050    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711053    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711056    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711059    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711061    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711065    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711070    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711073    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711075    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:50:04.714511 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711078    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711081    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711084    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711087    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711089    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711092    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711095    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711098    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711101    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711104    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711107    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711126    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711129    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711132    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711135    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711137    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711140    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711143    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711147    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711150    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:50:04.715054 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711152    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711156    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711159    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711162    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711165    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711168    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711171    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711174    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711177    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711183    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711185    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711188    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711191    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711194    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711197    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711200    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711202    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711205    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711208    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711211    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:50:04.715611 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711214    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711217    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711220    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711223    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711226    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711229    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711232    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711235    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711238    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711240    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711244    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711249    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711253    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711256    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711260    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711263    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711266    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711269    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711272    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:50:04.716144 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711275    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711278    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711284    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711287    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711290    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711292    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711295    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711298    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711302    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711304    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711307    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711310    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711314    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711317    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711321    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711324    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711327    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711330    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711334    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.711337    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:50:04.716671 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711429    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711451    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711461    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711469    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711475    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711479    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711484    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711489    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711493    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711496    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711500    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711504    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711509    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711513    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711518    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711521    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711525    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711528    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711533    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711537    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711540    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711544    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711548    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711552    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 07:50:04.717218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711555    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711559    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711562    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711566    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711569    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711573    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711576    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711579    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711587    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711590    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711594    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711596    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711600    2579 flags.go:64] FLAG: --enable-server="true"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711603    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711608    2579 flags.go:64] FLAG: --event-burst="100"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711611    2579 flags.go:64] FLAG: --event-qps="50"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711614    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711619    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711622    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711626    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711631    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711634    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711639    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711642    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711646    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 07:50:04.717868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711649    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711653    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711656    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711659    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711662    2579 flags.go:64] FLAG: --feature-gates=""
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711667    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711670    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711674    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711677    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711681    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711684    2579 flags.go:64] FLAG: --help="false"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711687    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-131-251.ec2.internal"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711691    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711694    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711697    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711700    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711704    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711707    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711710    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711713    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711716    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711719    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711723    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711726    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 14 07:50:04.718571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711729    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711733    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711737    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711742    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711745    2579 flags.go:64] FLAG: --lock-file=""
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711749    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711752    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711756    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711762    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711766    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711769    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711772    2579 flags.go:64] FLAG: --logging-format="text"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711775    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711779    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711783    2579 flags.go:64] FLAG: --manifest-url=""
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711786    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711791    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711795    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711799    2579 flags.go:64] FLAG: --max-pods="110"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711803    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711806    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711809    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711812    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711816    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711820    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 07:50:04.719221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711823    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711831    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711835    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711838    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711842    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711845    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711851    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711854    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711857    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711861    2579 flags.go:64] FLAG: --port="10250"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711866    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711870    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0676eb74766fa671f"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711873    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711877    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711881    2579 flags.go:64] FLAG: --register-node="true"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711884    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711888    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711892    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711895    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711898    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711903    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711907    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711910    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711914    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711917    2579 flags.go:64] FLAG: --runonce="false"
Jul 14 07:50:04.719866 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711920    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711923    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711926    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711930    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711933    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711936    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711939    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711943    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711946    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711949    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711952    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711955    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711958    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711962    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711965    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711971    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711974    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711980    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711985    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711988    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711992    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711995    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.711998    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.712001    2579 flags.go:64] FLAG: --v="2"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.712005    2579 flags.go:64] FLAG: --version="false"
Jul 14 07:50:04.720544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.712010    2579 flags.go:64] FLAG: --vmodule=""
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.712014    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.712017    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712164    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712169    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712173    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712176    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712179    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712182    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712185    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712189    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712192    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712196    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712200    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712203    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712206    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712210    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712213    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712215    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:50:04.721212 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712219    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712222    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712225    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712228    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712231    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712236    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712239    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712242    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712245    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712248    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712251    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712254    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712257    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712260    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712263    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712265    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712268    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712271    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712276    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712279    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:50:04.721749 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712282    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712285    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712288    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712292    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712295    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712298    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712301    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712304    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712308    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712311    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712314    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712316    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712319    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712322    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712325    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712329    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712333    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712339    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712342    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:50:04.722304 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712346    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712349    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712352    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712354    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712357    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712360    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712362    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712365    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712368    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712371    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712374    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712377    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712379    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712382    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712385    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712388    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712390    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712393    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712396    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712399    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:50:04.722815 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712401    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712404    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712407    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712410    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712412    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712415    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712418    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712420    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712423    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712426    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712431    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712435    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712437    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712441    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712444    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712446    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712449    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712452    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712455    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712457    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:50:04.723358 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712460    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712463    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712465    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.712468    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.713047    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.720735    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.720756    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.722052    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.722060    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722140    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722147    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722151    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722154    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722157    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:50:04.723901 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722160    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722164    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722167    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722170    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722173    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722176    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722178    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722181    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722184    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722187    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722190    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722193    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722196    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722199    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722202    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722205    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722208    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722211    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722214    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722216    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:50:04.724303 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722219    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722222    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722225    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722228    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722238    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722241    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722244    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722247    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722250    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722252    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722255    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722261    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722265    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722269    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722272    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722275    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722278    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722280    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722283    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722286    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:50:04.724827 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722289    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722292    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722295    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722298    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722301    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722304    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722307    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722310    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722313    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722316    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722319    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722322    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722325    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722329    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722333    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722336    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722339    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722349    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722352    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:50:04.725405 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722355    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722358    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722361    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722364    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722366    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722369    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722373    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722375    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722378    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722381    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722384    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722394    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722397    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722400    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722403    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722406    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722409    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722412    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722415    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722418    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:50:04.725923 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722420    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722423    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722426    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722429    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722432    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722435    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722438    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722441    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722446    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722450    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722453    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722463    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722466    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722469    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:50:04.726489 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722472    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.722478    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722689    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722696    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722699    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722702    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722705    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722708    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722711    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722714    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722717    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722720    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722723    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722726    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722729    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 07:50:04.726967 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722733    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722735    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722738    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722741    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722744    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722747    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722749    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722752    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722755    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722760    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722763    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722766    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722769    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722772    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722775    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722783    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722786    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722789    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722792    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 07:50:04.727398 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722795    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722798    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722800    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722803    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722806    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722809    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722812    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722814    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722817    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722820    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722823    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722826    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722829    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722832    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722835    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722838    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722841    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722844    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722846    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722849    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 07:50:04.727897 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722852    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722855    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722857    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722861    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722863    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722867    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722869    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722872    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722875    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722884    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722888    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722890    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722893    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722896    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722900    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722904    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722907    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722910    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722913    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722916    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 07:50:04.728435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722919    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722922    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722926    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722929    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722933    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722936    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722939    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722942    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722945    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722948    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722951    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722954    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722956    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722959    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722962    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722965    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722968    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722970    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722973    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 07:50:04.729294 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722976    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722980    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722984    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722993    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722996    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.722998    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.723001    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:04.723004    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.723009    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.723188    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.725911    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.727260    2579 server.go:1019] "Starting client certificate rotation"
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.727372    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 07:50:04.729872 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.728260    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 07:50:04.732645 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.732620    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 07:50:04.737321 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.737300    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 07:50:04.749527 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.749501    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 14 07:50:04.752915 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.752899    2579 log.go:25] "Validated CRI v1 image API"
Jul 14 07:50:04.753684 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.753667    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 07:50:04.756018 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.755997    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b6440c24-46e3-4703-bdfb-891e85d0b15a:/dev/nvme0n1p3 bc40f76b-ce50-4fea-b833-474eff0e7108:/dev/nvme0n1p4]
Jul 14 07:50:04.756065 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.756019    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 07:50:04.761553 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.761536    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 07:50:04.761924 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.761806    2579 manager.go:216] Machine: {Timestamp:2026-07-14 07:50:04.761123683 +0000 UTC m=+0.340130016 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101250 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e214b3011e2faf2c340f7b15c2328 SystemUUID:ec2e214b-3011-e2fa-f2c3-40f7b15c2328 BootID:2689109a-329f-4850-b91d-39f61dced191 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:f9:cf:65:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:f9:cf:65:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:f2:97:c2:75:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 07:50:04.761924 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.761922    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 07:50:04.762031 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.762015    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 07:50:04.765857 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.765825    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 07:50:04.766019 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.765861    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-251.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 07:50:04.766784 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.766772    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 07:50:04.766819 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.766787    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 07:50:04.766819 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.766800    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 07:50:04.766819 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.766814    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 07:50:04.768272 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.768260    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 07:50:04.771345 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.771332    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 07:50:04.771486 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.771475    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 07:50:04.771526 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.771513    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 07:50:04.771556 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.771551    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 07:50:04.771596 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.771588    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 07:50:04.771630 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.771613    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 14 07:50:04.771662 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.771630    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 07:50:04.772094 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.772077    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 07:50:04.772167 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.772123    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 07:50:04.774829 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.774791    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 07:50:04.780524 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.780504    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 07:50:04.780631 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.780540    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 07:50:04.780728 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.780717    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 07:50:04.780761 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.780733    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 07:50:04.780761 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.780741    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 07:50:04.780761 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.780747    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 07:50:04.780761 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.780756    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 07:50:04.780877 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.780762    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 07:50:04.781984 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.781973    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 07:50:04.781984 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.781984    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 07:50:04.782057 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.781993    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 07:50:04.782057 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.781999    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 07:50:04.782057 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.782008    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 07:50:04.782057 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.782016    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 07:50:04.783382 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.783371    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 07:50:04.783382 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.783381    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 07:50:04.786461 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.786439    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-251.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 07:50:04.786534 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.786460    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 07:50:04.786534 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.786459    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 07:50:04.787052 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.787031    2579 server.go:1268] "Started kubelet"
Jul 14 07:50:04.787198 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.787150    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 07:50:04.787242 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.787220    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 07:50:04.787320 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.787292    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 07:50:04.787976 ip-10-0-131-251 systemd[1]: Started Kubernetes Kubelet.
Jul 14 07:50:04.788146 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.788058    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xqg9"
Jul 14 07:50:04.788593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.788481    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 07:50:04.790502 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.790480    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 07:50:04.794620 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.794590    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 07:50:04.794726 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.794713    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 07:50:04.794801 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.794730    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 07:50:04.794853 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.794794    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:04.795481 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795461    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 07:50:04.795481 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795482    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 07:50:04.795621 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795599    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 07:50:04.795691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795632    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 07:50:04.795691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795641    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 07:50:04.795691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795632    2579 factory.go:55] Registering systemd factory
Jul 14 07:50:04.795691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795667    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 14 07:50:04.795900 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795884    2579 factory.go:153] Registering CRI-O factory
Jul 14 07:50:04.795964 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795908    2579 factory.go:223] Registration of the crio container factory successfully
Jul 14 07:50:04.795964 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795959    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 07:50:04.796090 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.795983    2579 factory.go:103] Registering Raw factory
Jul 14 07:50:04.796090 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.796000    2579 manager.go:1196] Started watching for new ooms in manager
Jul 14 07:50:04.796280 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.795232    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-251.ec2.internal.18c2188efc2767f8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-251.ec2.internal,UID:ip-10-0-131-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-251.ec2.internal,},FirstTimestamp:2026-07-14 07:50:04.787001336 +0000 UTC m=+0.366007669,LastTimestamp:2026-07-14 07:50:04.787001336 +0000 UTC m=+0.366007669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-251.ec2.internal,}"
Jul 14 07:50:04.796586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.796567    2579 manager.go:349] Starting recovery of all containers
Jul 14 07:50:04.797661 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.797637    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xqg9"
Jul 14 07:50:04.803428 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.803395    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 07:50:04.803567 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.803521    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 07:50:04.812022 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.811880    2579 manager.go:354] Recovery completed
Jul 14 07:50:04.816618 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.816605    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:50:04.819029 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.819011    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:50:04.819150 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.819045    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:50:04.819150 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.819060    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:50:04.819735 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.819721    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 07:50:04.819735 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.819735    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 07:50:04.819848 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.819752    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 07:50:04.819848 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.819797    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:50:04.820677 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.820655    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:50:04.820751 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.820696    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:50:04.820751 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.820714    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:50:04.820991 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.820979    2579 policy_none.go:49] "None policy: Start"
Jul 14 07:50:04.821036 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.820997    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 07:50:04.821036 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.821008    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 07:50:04.822081 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.822068    2579 policy_none.go:47] "Start"
Jul 14 07:50:04.857726 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.857706    2579 manager.go:337] "Starting Device Plugin manager"
Jul 14 07:50:04.857833 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.857743    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 07:50:04.857833 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.857754    2579 server.go:87] "Starting device plugin registration server"
Jul 14 07:50:04.858130 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.858104    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 07:50:04.858212 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.858123    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 07:50:04.858267 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.858246    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 07:50:04.858343 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.858330    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 07:50:04.858343 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.858343    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 07:50:04.858906 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.858872    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 07:50:04.859011 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.858947    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:04.963304 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.963199    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:50:04.964565 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.964385    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:50:04.964565 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.964426    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:50:04.964565 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.964442    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:50:04.964565 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.964485    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-251.ec2.internal"
Jul 14 07:50:04.973540 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.973522    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-251.ec2.internal"
Jul 14 07:50:04.973540 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.973548    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-251.ec2.internal\": node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:04.977289 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.977259    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 07:50:04.978684 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.978661    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 07:50:04.978789 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.978701    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 07:50:04.978789 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.978788    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 07:50:04.978907 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.978835    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 07:50:04.981091 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:04.981063    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:50:04.990093 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:04.990075    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.079293 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.079250    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal"]
Jul 14 07:50:05.079405 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.079343    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:50:05.080449 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.080425    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:50:05.080581 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.080459    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:50:05.080581 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.080474    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:50:05.081875 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.081860    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:50:05.081998 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.081982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.082060 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.082018    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:50:05.082652 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.082635    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:50:05.082710 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.082668    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:50:05.082710 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.082679    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:50:05.082775 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.082635    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:50:05.082775 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.082744    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:50:05.082775 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.082758    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:50:05.083962 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.083946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.084020 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.083981    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 07:50:05.084739 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.084719    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 07:50:05.084817 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.084755    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 07:50:05.084817 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.084772    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeHasSufficientPID"
Jul 14 07:50:05.090215 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.090200    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.096206 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.096189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa849f63d6070118ce2c0ebb1cff75f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal\" (UID: \"aa849f63d6070118ce2c0ebb1cff75f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.096265 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.096217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa849f63d6070118ce2c0ebb1cff75f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal\" (UID: \"aa849f63d6070118ce2c0ebb1cff75f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.096265 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.096235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45a109eebdae577f01fcda859fc8c61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-251.ec2.internal\" (UID: \"45a109eebdae577f01fcda859fc8c61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.101689 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.101672    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-251.ec2.internal\" not found" node="ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.105217 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.105199    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-251.ec2.internal\" not found" node="ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.190469 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.190430    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.196860 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.196836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa849f63d6070118ce2c0ebb1cff75f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal\" (UID: \"aa849f63d6070118ce2c0ebb1cff75f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.196940 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.196871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa849f63d6070118ce2c0ebb1cff75f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal\" (UID: \"aa849f63d6070118ce2c0ebb1cff75f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.196940 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.196893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45a109eebdae577f01fcda859fc8c61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-251.ec2.internal\" (UID: \"45a109eebdae577f01fcda859fc8c61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.197036 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.196937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa849f63d6070118ce2c0ebb1cff75f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal\" (UID: \"aa849f63d6070118ce2c0ebb1cff75f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.197036 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.196969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa849f63d6070118ce2c0ebb1cff75f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal\" (UID: \"aa849f63d6070118ce2c0ebb1cff75f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.197036 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.196938    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45a109eebdae577f01fcda859fc8c61c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-251.ec2.internal\" (UID: \"45a109eebdae577f01fcda859fc8c61c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.290996 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.290922    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.398715 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.398668    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.404271 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.404241    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.408654 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.408372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:05.499400 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.499354    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.599677 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.599594    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.700618 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.700579    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.727139 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.727103    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 07:50:05.727760 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.727287    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 07:50:05.798101 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.798075    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:50:05.800679 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.800661    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.802066 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.802031    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 07:45:05 +0000 UTC" deadline="2028-04-04 22:03:27.001058692 +0000 UTC"
Jul 14 07:50:05.802130 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.802066    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15134h13m21.198996254s"
Jul 14 07:50:05.901391 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:05.901345    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:05.980528 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:05.980493    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa849f63d6070118ce2c0ebb1cff75f1.slice/crio-976fca1af8a732ab0a437c82f099dddaa2cc57ea1ac1aa3663857cf437e97243 WatchSource:0}: Error finding container 976fca1af8a732ab0a437c82f099dddaa2cc57ea1ac1aa3663857cf437e97243: Status 404 returned error can't find the container with id 976fca1af8a732ab0a437c82f099dddaa2cc57ea1ac1aa3663857cf437e97243
Jul 14 07:50:05.986997 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:05.986977    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 07:50:05.992825 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:05.992784    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a109eebdae577f01fcda859fc8c61c.slice/crio-b35bb7ca1ed9fd5bc6c36f9f3900a1bebf16bed8f03cacdc66e76f52012b77d3 WatchSource:0}: Error finding container b35bb7ca1ed9fd5bc6c36f9f3900a1bebf16bed8f03cacdc66e76f52012b77d3: Status 404 returned error can't find the container with id b35bb7ca1ed9fd5bc6c36f9f3900a1bebf16bed8f03cacdc66e76f52012b77d3
Jul 14 07:50:06.002303 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:06.002239    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-251.ec2.internal\" not found"
Jul 14 07:50:06.064873 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.064841    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:50:06.097255 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.097221    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:06.110203 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.110174    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 07:50:06.111870 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.111856    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal"
Jul 14 07:50:06.119558 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.119536    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 07:50:06.295937 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.295844    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:50:06.774525 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.774426    2579 apiserver.go:52] "Watching apiserver"
Jul 14 07:50:06.783515 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.783266    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 07:50:06.786044 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.785722    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xbsmz","kube-system/global-pull-secret-syncer-hz6wd","kube-system/konnectivity-agent-8g8g8","kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb","openshift-multus/multus-additional-cni-plugins-jdq6p","openshift-network-diagnostics/network-check-target-vkrgz","openshift-network-operator/iptables-alerter-lxhqb","openshift-cluster-node-tuning-operator/tuned-k429w","openshift-dns/node-resolver-lhd7p","openshift-image-registry/node-ca-c9r5l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal","openshift-multus/multus-lxsbq","openshift-multus/network-metrics-daemon-wswkj"]
Jul 14 07:50:06.787389 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.787364    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.788902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.788813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.790068 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.790024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:06.790559 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.790495    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 07:50:06.790665 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.790494    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 07:50:06.790915 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.790502    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-55zrk\""
Jul 14 07:50:06.791981 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.791600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:06.791981 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:06.791681    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:06.791981 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.791780    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 07:50:06.791981 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.791794    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-plbxq\""
Jul 14 07:50:06.791981 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.791819    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 07:50:06.791981 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.791916    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 07:50:06.792451 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.792030    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 07:50:06.792946 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.792910    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9b8h2\""
Jul 14 07:50:06.793232 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.793212    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 07:50:06.793321 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.793271    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 07:50:06.794364 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.794344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.796495 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.796475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.796769 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.796748    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 07:50:06.797028 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.797008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 07:50:06.797193 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.797018    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x7jfs\""
Jul 14 07:50:06.797276 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.797236    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 07:50:06.797461 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.797441    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 07:50:06.799441 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.798950    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 07:50:06.799441 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.799260    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hz5rs\""
Jul 14 07:50:06.800037 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.799689    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.800037 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.799786    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 07:50:06.802311 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.802203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:06.802311 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:06.802288    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:06.805439 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.805414    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:06.805633 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:06.805606    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:06.805701 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.805653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.805896 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.805872    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:50:06.806126 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.806102    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 07:50:06.807058 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807036    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c7bkq\""
Jul 14 07:50:06.807169 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjf4\" (UniqueName: \"kubernetes.io/projected/7f101914-c17b-49ee-bb14-c7d8817badeb-kube-api-access-zdjf4\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.807245 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-hostroot\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.807317 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhx97\" (UniqueName: \"kubernetes.io/projected/36aaafad-3048-4a70-8bb8-4e27405222f0-kube-api-access-zhx97\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.807499 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-registration-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.807499 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-device-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.807499 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-os-release\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.807499 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-sys\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.807714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4470a571-3e6e-4281-9e42-dbc7ed28ab42-hosts-file\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.807714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg65j\" (UniqueName: \"kubernetes.io/projected/4470a571-3e6e-4281-9e42-dbc7ed28ab42-kube-api-access-fg65j\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.807714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-cnibin\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.807714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-k8s-cni-cncf-io\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.807714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-cni-multus\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.807957 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-daemon-config\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.807957 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd3b864f-7006-4e05-a4f3-8dd121a27827-konnectivity-ca\") pod \"konnectivity-agent-8g8g8\" (UID: \"bd3b864f-7006-4e05-a4f3-8dd121a27827\") " pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:06.807957 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-sys-fs\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.807957 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:06.807957 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-modprobe-d\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.807957 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-kubelet\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.807957 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-conf-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.808342 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.807963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv5c4\" (UniqueName: \"kubernetes.io/projected/eae2e531-478b-4e27-8a59-579380fe0d4c-kube-api-access-gv5c4\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.808342 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysctl-conf\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.808342 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-var-lib-kubelet\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.808501 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-socket-dir-parent\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.808501 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-netns\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.808501 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxzc9\" (UniqueName: \"kubernetes.io/projected/0ed038c2-74e2-4ce0-bbdd-206378df7c25-kube-api-access-bxzc9\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:06.808659 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.808659 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.808659 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7ph2\" (UniqueName: \"kubernetes.io/projected/6319dcc6-4314-441a-a84b-bfcb62468c2b-kube-api-access-r7ph2\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.808803 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-lib-modules\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.808803 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-system-cni-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.808803 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-etc-kubernetes\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.808803 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.809007 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-system-cni-dir\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.809007 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-kubernetes\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.809007 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysctl-d\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.809007 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-run\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.809007 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4470a571-3e6e-4281-9e42-dbc7ed28ab42-tmp-dir\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.809007 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.808954    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-cni-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.809324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809027    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.809324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-systemd\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.809324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-tuned\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.809324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36aaafad-3048-4a70-8bb8-4e27405222f0-cni-binary-copy\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.809324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809206    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-cni-bin\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.809324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-multus-certs\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.809324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809273    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd3b864f-7006-4e05-a4f3-8dd121a27827-agent-certs\") pod \"konnectivity-agent-8g8g8\" (UID: \"bd3b864f-7006-4e05-a4f3-8dd121a27827\") " pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:06.809324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:06.809714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-socket-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.809714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-cnibin\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.809714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-os-release\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.809863 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.809863 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.809863 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysconfig\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.810007 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.809981    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwqd5\""
Jul 14 07:50:06.810063 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.810044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-host\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.810178 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.810154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 07:50:06.810243 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.810213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f101914-c17b-49ee-bb14-c7d8817badeb-tmp\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.810295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.810242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:06.810295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.810252    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 07:50:06.810506 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.810484    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 07:50:06.811401 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.811382    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 07:50:06.812717 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.812696    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 07:50:06.812814 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.812700    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 07:50:06.812814 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.812706    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 07:50:06.812947 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.812924    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8554\""
Jul 14 07:50:06.813023 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.812929    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 07:50:06.813023 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.812931    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 07:50:06.813583 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.813562    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 07:50:06.813731 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.813567    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:50:06.814275 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.814253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8q749\""
Jul 14 07:50:06.815421 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.815398    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 07:50:06.816043 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.816019    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 07:50:06.834434 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.834398    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9w46j"
Jul 14 07:50:06.843096 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.843070    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9w46j"
Jul 14 07:50:06.896953 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.896922    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 07:50:06.911287 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysconfig\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.911287 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f101914-c17b-49ee-bb14-c7d8817badeb-tmp\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-systemd-units\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-os-release\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjf4\" (UniqueName: \"kubernetes.io/projected/7f101914-c17b-49ee-bb14-c7d8817badeb-kube-api-access-zdjf4\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4470a571-3e6e-4281-9e42-dbc7ed28ab42-hosts-file\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-hostroot\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-slash\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b93824ee-53c0-4eec-a3d3-88bc418d6e86-iptables-alerter-script\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-cni-multus\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd3b864f-7006-4e05-a4f3-8dd121a27827-konnectivity-ca\") pod \"konnectivity-agent-8g8g8\" (UID: \"bd3b864f-7006-4e05-a4f3-8dd121a27827\") " pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-sys-fs\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.911586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3848661b-bad6-4761-9823-1d213895ab2a-dbus\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-ovn\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-node-log\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovnkube-script-lib\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv5c4\" (UniqueName: \"kubernetes.io/projected/eae2e531-478b-4e27-8a59-579380fe0d4c-kube-api-access-gv5c4\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-netns\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxzc9\" (UniqueName: \"kubernetes.io/projected/0ed038c2-74e2-4ce0-bbdd-206378df7c25-kube-api-access-bxzc9\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.911977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-cni-multus\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.912308 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912264    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 07:50:06.912754 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd3b864f-7006-4e05-a4f3-8dd121a27827-konnectivity-ca\") pod \"konnectivity-agent-8g8g8\" (UID: \"bd3b864f-7006-4e05-a4f3-8dd121a27827\") " pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:06.912754 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-sys-fs\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.912908 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysconfig\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.912908 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.912908 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4470a571-3e6e-4281-9e42-dbc7ed28ab42-hosts-file\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.912908 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ph2\" (UniqueName: \"kubernetes.io/projected/6319dcc6-4314-441a-a84b-bfcb62468c2b-kube-api-access-r7ph2\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.913108 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-cni-netd\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.913108 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-os-release\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913108 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-env-overrides\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.913108 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-system-cni-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913108 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.912994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.913108 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-etc-kubernetes\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913108 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913053    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-system-cni-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913108 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-serviceca\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:06.913698 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-etc-kubernetes\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913698 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-netns\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913698 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-hostroot\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913698 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-cni-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-cni-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.913902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.913902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-systemd\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.913902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-var-lib-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.913902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-log-socket\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.913902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fb4z\" (UniqueName: \"kubernetes.io/projected/99e14a82-88d7-406f-8f8a-3bd65351cae7-kube-api-access-2fb4z\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.913902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.913902 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-host\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:06.914331 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36aaafad-3048-4a70-8bb8-4e27405222f0-cni-binary-copy\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.914331 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-cni-bin\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.914331 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-systemd\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.914331 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.913982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd3b864f-7006-4e05-a4f3-8dd121a27827-agent-certs\") pod \"konnectivity-agent-8g8g8\" (UID: \"bd3b864f-7006-4e05-a4f3-8dd121a27827\") " pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:06.914331 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914074    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-cni-bin\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.914593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:06.914593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-socket-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.914593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.914593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-host\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.914593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg65j\" (UniqueName: \"kubernetes.io/projected/4470a571-3e6e-4281-9e42-dbc7ed28ab42-kube-api-access-fg65j\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-run-netns\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36aaafad-3048-4a70-8bb8-4e27405222f0-cni-binary-copy\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-cni-bin\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovn-node-metrics-cert\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88mdf\" (UniqueName: \"kubernetes.io/projected/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-kube-api-access-88mdf\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b93824ee-53c0-4eec-a3d3-88bc418d6e86-host-slash\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:06.914767    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhx97\" (UniqueName: \"kubernetes.io/projected/36aaafad-3048-4a70-8bb8-4e27405222f0-kube-api-access-zhx97\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.914841 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:06.914836    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs podName:0ed038c2-74e2-4ce0-bbdd-206378df7c25 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:07.414812478 +0000 UTC m=+2.993818799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs") pod "network-metrics-daemon-wswkj" (UID: "0ed038c2-74e2-4ce0-bbdd-206378df7c25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-registration-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-device-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-os-release\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-sys\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.914976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-cnibin\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-k8s-cni-cncf-io\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-daemon-config\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-modprobe-d\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915117    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysctl-conf\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-var-lib-kubelet\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3848661b-bad6-4761-9823-1d213895ab2a-kubelet-config\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-kubelet\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-conf-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-systemd\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-etc-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.915393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-socket-dir-parent\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-lib-modules\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-system-cni-dir\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-kubernetes\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysctl-d\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-run\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4470a571-3e6e-4281-9e42-dbc7ed28ab42-tmp-dir\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovnkube-config\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-tuned\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-kubelet\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbqq2\" (UniqueName: \"kubernetes.io/projected/b93824ee-53c0-4eec-a3d3-88bc418d6e86-kube-api-access-dbqq2\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-multus-certs\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-cnibin\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.916269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.915978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-host\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-socket-dir-parent\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-registration-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-device-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-os-release\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916278    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-sys\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-cnibin\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-k8s-cni-cncf-io\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916420    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f101914-c17b-49ee-bb14-c7d8817badeb-tmp\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-var-lib-kubelet\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916882    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-daemon-config\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6319dcc6-4314-441a-a84b-bfcb62468c2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-modprobe-d\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-lib-modules\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.917141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917085    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysctl-conf\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917156    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-system-cni-dir\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-kubernetes\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-sysctl-d\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917370    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-run\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.916984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f101914-c17b-49ee-bb14-c7d8817badeb-var-lib-kubelet\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917404    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4470a571-3e6e-4281-9e42-dbc7ed28ab42-tmp-dir\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-multus-conf-dir\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36aaafad-3048-4a70-8bb8-4e27405222f0-host-run-multus-certs\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6319dcc6-4314-441a-a84b-bfcb62468c2b-cnibin\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.918211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.917811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eae2e531-478b-4e27-8a59-579380fe0d4c-socket-dir\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.921980 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.921501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd3b864f-7006-4e05-a4f3-8dd121a27827-agent-certs\") pod \"konnectivity-agent-8g8g8\" (UID: \"bd3b864f-7006-4e05-a4f3-8dd121a27827\") " pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:06.934985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.931737    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7ph2\" (UniqueName: \"kubernetes.io/projected/6319dcc6-4314-441a-a84b-bfcb62468c2b-kube-api-access-r7ph2\") pod \"multus-additional-cni-plugins-jdq6p\" (UID: \"6319dcc6-4314-441a-a84b-bfcb62468c2b\") " pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:06.934985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.931802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxzc9\" (UniqueName: \"kubernetes.io/projected/0ed038c2-74e2-4ce0-bbdd-206378df7c25-kube-api-access-bxzc9\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:06.934985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.932220    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhx97\" (UniqueName: \"kubernetes.io/projected/36aaafad-3048-4a70-8bb8-4e27405222f0-kube-api-access-zhx97\") pod \"multus-lxsbq\" (UID: \"36aaafad-3048-4a70-8bb8-4e27405222f0\") " pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:06.934985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.932294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg65j\" (UniqueName: \"kubernetes.io/projected/4470a571-3e6e-4281-9e42-dbc7ed28ab42-kube-api-access-fg65j\") pod \"node-resolver-lhd7p\" (UID: \"4470a571-3e6e-4281-9e42-dbc7ed28ab42\") " pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:06.934985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.932570    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f101914-c17b-49ee-bb14-c7d8817badeb-etc-tuned\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.934985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.933268    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv5c4\" (UniqueName: \"kubernetes.io/projected/eae2e531-478b-4e27-8a59-579380fe0d4c-kube-api-access-gv5c4\") pod \"aws-ebs-csi-driver-node-bgnqb\" (UID: \"eae2e531-478b-4e27-8a59-579380fe0d4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:06.937137 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.937110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjf4\" (UniqueName: \"kubernetes.io/projected/7f101914-c17b-49ee-bb14-c7d8817badeb-kube-api-access-zdjf4\") pod \"tuned-k429w\" (UID: \"7f101914-c17b-49ee-bb14-c7d8817badeb\") " pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:06.984024 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.983957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal" event={"ID":"45a109eebdae577f01fcda859fc8c61c","Type":"ContainerStarted","Data":"b35bb7ca1ed9fd5bc6c36f9f3900a1bebf16bed8f03cacdc66e76f52012b77d3"}
Jul 14 07:50:06.985376 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:06.985312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal" event={"ID":"aa849f63d6070118ce2c0ebb1cff75f1","Type":"ContainerStarted","Data":"976fca1af8a732ab0a437c82f099dddaa2cc57ea1ac1aa3663857cf437e97243"}
Jul 14 07:50:07.016393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3848661b-bad6-4761-9823-1d213895ab2a-dbus\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-ovn\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-node-log\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovnkube-script-lib\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-cni-netd\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-env-overrides\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-serviceca\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-var-lib-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-log-socket\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fb4z\" (UniqueName: \"kubernetes.io/projected/99e14a82-88d7-406f-8f8a-3bd65351cae7-kube-api-access-2fb4z\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3848661b-bad6-4761-9823-1d213895ab2a-dbus\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016614    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-node-log\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.016643 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-host\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-ovn\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-host\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-run-netns\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-cni-bin\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovn-node-metrics-cert\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88mdf\" (UniqueName: \"kubernetes.io/projected/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-kube-api-access-88mdf\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b93824ee-53c0-4eec-a3d3-88bc418d6e86-host-slash\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3848661b-bad6-4761-9823-1d213895ab2a-kubelet-config\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-systemd\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.016990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-etc-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovnkube-config\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-kubelet\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.017325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-serviceca\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbqq2\" (UniqueName: \"kubernetes.io/projected/b93824ee-53c0-4eec-a3d3-88bc418d6e86-kube-api-access-dbqq2\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovnkube-script-lib\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-systemd-units\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-slash\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b93824ee-53c0-4eec-a3d3-88bc418d6e86-iptables-alerter-script\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017348    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-run-netns\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-systemd-units\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-cni-bin\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-cni-netd\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.017468    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017547    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-slash\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.017628    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret podName:3848661b-bad6-4761-9823-1d213895ab2a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:07.517608226 +0000 UTC m=+3.096614550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret") pod "global-pull-secret-syncer-hz6wd" (UID: "3848661b-bad6-4761-9823-1d213895ab2a") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-systemd\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-etc-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.018202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-run-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.019005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-env-overrides\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.019005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-log-socket\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.019005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.017935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b93824ee-53c0-4eec-a3d3-88bc418d6e86-iptables-alerter-script\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:07.019005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.018067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-host-kubelet\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.019005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.018127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99e14a82-88d7-406f-8f8a-3bd65351cae7-var-lib-openvswitch\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.019005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.018246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovnkube-config\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.019005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.018249    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3848661b-bad6-4761-9823-1d213895ab2a-kubelet-config\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:07.019005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.018317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b93824ee-53c0-4eec-a3d3-88bc418d6e86-host-slash\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:07.020703 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.020679    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99e14a82-88d7-406f-8f8a-3bd65351cae7-ovn-node-metrics-cert\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.025530 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.025461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbqq2\" (UniqueName: \"kubernetes.io/projected/b93824ee-53c0-4eec-a3d3-88bc418d6e86-kube-api-access-dbqq2\") pod \"iptables-alerter-lxhqb\" (UID: \"b93824ee-53c0-4eec-a3d3-88bc418d6e86\") " pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:07.026643 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.026617    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:50:07.026643 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.026644    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:50:07.026812 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.026659    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8pnsw for pod openshift-network-diagnostics/network-check-target-vkrgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:07.026812 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.026733    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw podName:998ec576-9e5f-4dc6-bf7e-aa4e0e658436 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:07.526712564 +0000 UTC m=+3.105718887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8pnsw" (UniqueName: "kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw") pod "network-check-target-vkrgz" (UID: "998ec576-9e5f-4dc6-bf7e-aa4e0e658436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:07.033221 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.033196    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88mdf\" (UniqueName: \"kubernetes.io/projected/d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc-kube-api-access-88mdf\") pod \"node-ca-c9r5l\" (UID: \"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc\") " pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:07.033333 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.033311    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fb4z\" (UniqueName: \"kubernetes.io/projected/99e14a82-88d7-406f-8f8a-3bd65351cae7-kube-api-access-2fb4z\") pod \"ovnkube-node-xbsmz\" (UID: \"99e14a82-88d7-406f-8f8a-3bd65351cae7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.101436 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.101396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lhd7p"
Jul 14 07:50:07.112052 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.112003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lxsbq"
Jul 14 07:50:07.124159 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.124126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:07.129964 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.129939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb"
Jul 14 07:50:07.138905 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.138880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jdq6p"
Jul 14 07:50:07.145681 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.145654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k429w"
Jul 14 07:50:07.153520 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.153497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:07.161357 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.161333    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c9r5l"
Jul 14 07:50:07.170311 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.170282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lxhqb"
Jul 14 07:50:07.273957 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.273921    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 07:50:07.420586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.420486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:07.420773 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.420691    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:07.420835 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.420783    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs podName:0ed038c2-74e2-4ce0-bbdd-206378df7c25 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:08.420758677 +0000 UTC m=+3.999764997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs") pod "network-metrics-daemon-wswkj" (UID: "0ed038c2-74e2-4ce0-bbdd-206378df7c25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:07.521542 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.521492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:07.521751 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.521681    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:07.521818 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.521770    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret podName:3848661b-bad6-4761-9823-1d213895ab2a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:08.521752332 +0000 UTC m=+4.100758654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret") pod "global-pull-secret-syncer-hz6wd" (UID: "3848661b-bad6-4761-9823-1d213895ab2a") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:07.622382 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.622342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:07.622574 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.622505    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:50:07.622574 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.622530    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:50:07.622574 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.622543    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8pnsw for pod openshift-network-diagnostics/network-check-target-vkrgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:07.622740 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.622614    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw podName:998ec576-9e5f-4dc6-bf7e-aa4e0e658436 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:08.622594797 +0000 UTC m=+4.201601117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pnsw" (UniqueName: "kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw") pod "network-check-target-vkrgz" (UID: "998ec576-9e5f-4dc6-bf7e-aa4e0e658436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:07.845287 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.845168    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 07:45:07 +0000 UTC" deadline="2028-03-01 03:57:16.100023776 +0000 UTC"
Jul 14 07:50:07.845287 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.845216    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14300h7m8.254814619s"
Jul 14 07:50:07.979156 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:07.979114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:07.979343 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:07.979265    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:08.078433 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.078398    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4470a571_3e6e_4281_9e42_dbc7ed28ab42.slice/crio-6c7c760a0cbad3c945d1aceaf590388ab408b5540d9c97932d5100ba3547d2f1 WatchSource:0}: Error finding container 6c7c760a0cbad3c945d1aceaf590388ab408b5540d9c97932d5100ba3547d2f1: Status 404 returned error can't find the container with id 6c7c760a0cbad3c945d1aceaf590388ab408b5540d9c97932d5100ba3547d2f1
Jul 14 07:50:08.082748 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.082632    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6319dcc6_4314_441a_a84b_bfcb62468c2b.slice/crio-6efe30964901f3a704d1e6991cb971334892574f5a646882cd41474c041ea516 WatchSource:0}: Error finding container 6efe30964901f3a704d1e6991cb971334892574f5a646882cd41474c041ea516: Status 404 returned error can't find the container with id 6efe30964901f3a704d1e6991cb971334892574f5a646882cd41474c041ea516
Jul 14 07:50:08.085375 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.085344    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93824ee_53c0_4eec_a3d3_88bc418d6e86.slice/crio-e49685aadb6da925481bf324d61db21806243afa164eab3a76a96b7581e6f55d WatchSource:0}: Error finding container e49685aadb6da925481bf324d61db21806243afa164eab3a76a96b7581e6f55d: Status 404 returned error can't find the container with id e49685aadb6da925481bf324d61db21806243afa164eab3a76a96b7581e6f55d
Jul 14 07:50:08.086156 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.086116    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3b864f_7006_4e05_a4f3_8dd121a27827.slice/crio-396376be481a3d9460112334cd024ff1847ae3120d9f0f971c5d8096f34b54c2 WatchSource:0}: Error finding container 396376be481a3d9460112334cd024ff1847ae3120d9f0f971c5d8096f34b54c2: Status 404 returned error can't find the container with id 396376be481a3d9460112334cd024ff1847ae3120d9f0f971c5d8096f34b54c2
Jul 14 07:50:08.087157 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.087134    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f101914_c17b_49ee_bb14_c7d8817badeb.slice/crio-e6af2516506b366e02465233ce5636c6dfab2145337bf622a6593a00be1a5fb0 WatchSource:0}: Error finding container e6af2516506b366e02465233ce5636c6dfab2145337bf622a6593a00be1a5fb0: Status 404 returned error can't find the container with id e6af2516506b366e02465233ce5636c6dfab2145337bf622a6593a00be1a5fb0
Jul 14 07:50:08.089449 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.089428    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae2e531_478b_4e27_8a59_579380fe0d4c.slice/crio-3fd371f2b50c303a3776f6867ad70cb19ec5a6400d793639d8ff4976e37ef199 WatchSource:0}: Error finding container 3fd371f2b50c303a3776f6867ad70cb19ec5a6400d793639d8ff4976e37ef199: Status 404 returned error can't find the container with id 3fd371f2b50c303a3776f6867ad70cb19ec5a6400d793639d8ff4976e37ef199
Jul 14 07:50:08.091280 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.091260    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36aaafad_3048_4a70_8bb8_4e27405222f0.slice/crio-58eb25f7791b9e80c1dcab210642289ee2f84b1af58b072939fe8cad425be404 WatchSource:0}: Error finding container 58eb25f7791b9e80c1dcab210642289ee2f84b1af58b072939fe8cad425be404: Status 404 returned error can't find the container with id 58eb25f7791b9e80c1dcab210642289ee2f84b1af58b072939fe8cad425be404
Jul 14 07:50:08.117941 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.117910    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a6a9ee_55d0_49d1_9ba3_f29f1aa045bc.slice/crio-f5a6a0d7c37d2380b8df9e0a80161e2e052e1e354a6c27a47afdc32406db24dd WatchSource:0}: Error finding container f5a6a0d7c37d2380b8df9e0a80161e2e052e1e354a6c27a47afdc32406db24dd: Status 404 returned error can't find the container with id f5a6a0d7c37d2380b8df9e0a80161e2e052e1e354a6c27a47afdc32406db24dd
Jul 14 07:50:08.118620 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:08.118590    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e14a82_88d7_406f_8f8a_3bd65351cae7.slice/crio-af0cdf9d3f093463515c360b9b4a8e9aac55b88268c21be70c08ebd65a885012 WatchSource:0}: Error finding container af0cdf9d3f093463515c360b9b4a8e9aac55b88268c21be70c08ebd65a885012: Status 404 returned error can't find the container with id af0cdf9d3f093463515c360b9b4a8e9aac55b88268c21be70c08ebd65a885012
Jul 14 07:50:08.428541 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:08.428258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:08.428541 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.428415    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:08.428748 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.428548    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs podName:0ed038c2-74e2-4ce0-bbdd-206378df7c25 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:10.428532292 +0000 UTC m=+6.007538612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs") pod "network-metrics-daemon-wswkj" (UID: "0ed038c2-74e2-4ce0-bbdd-206378df7c25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:08.529857 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:08.529781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:08.530120 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.529952    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:08.530120 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.530023    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret podName:3848661b-bad6-4761-9823-1d213895ab2a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:10.53000205 +0000 UTC m=+6.109008373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret") pod "global-pull-secret-syncer-hz6wd" (UID: "3848661b-bad6-4761-9823-1d213895ab2a") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:08.630755 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:08.630613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:08.630957 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.630842    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:50:08.630957 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.630864    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:50:08.630957 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.630878    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8pnsw for pod openshift-network-diagnostics/network-check-target-vkrgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:08.630957 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.630947    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw podName:998ec576-9e5f-4dc6-bf7e-aa4e0e658436 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:10.630924539 +0000 UTC m=+6.209930882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pnsw" (UniqueName: "kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw") pod "network-check-target-vkrgz" (UID: "998ec576-9e5f-4dc6-bf7e-aa4e0e658436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:08.846503 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:08.846378    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 07:45:07 +0000 UTC" deadline="2028-02-18 04:16:56.659065317 +0000 UTC"
Jul 14 07:50:08.846503 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:08.846449    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14012h26m47.812620796s"
Jul 14 07:50:08.986962 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:08.986918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:08.987197 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.987124    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:08.987612 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:08.987589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:08.987771 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:08.987746    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:09.001393 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.001350    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"af0cdf9d3f093463515c360b9b4a8e9aac55b88268c21be70c08ebd65a885012"}
Jul 14 07:50:09.009368 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.009294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c9r5l" event={"ID":"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc","Type":"ContainerStarted","Data":"f5a6a0d7c37d2380b8df9e0a80161e2e052e1e354a6c27a47afdc32406db24dd"}
Jul 14 07:50:09.017405 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.017365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lxsbq" event={"ID":"36aaafad-3048-4a70-8bb8-4e27405222f0","Type":"ContainerStarted","Data":"58eb25f7791b9e80c1dcab210642289ee2f84b1af58b072939fe8cad425be404"}
Jul 14 07:50:09.028253 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.028214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb" event={"ID":"eae2e531-478b-4e27-8a59-579380fe0d4c","Type":"ContainerStarted","Data":"3fd371f2b50c303a3776f6867ad70cb19ec5a6400d793639d8ff4976e37ef199"}
Jul 14 07:50:09.036951 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.036910    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k429w" event={"ID":"7f101914-c17b-49ee-bb14-c7d8817badeb","Type":"ContainerStarted","Data":"e6af2516506b366e02465233ce5636c6dfab2145337bf622a6593a00be1a5fb0"}
Jul 14 07:50:09.055143 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.050626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" event={"ID":"6319dcc6-4314-441a-a84b-bfcb62468c2b","Type":"ContainerStarted","Data":"6efe30964901f3a704d1e6991cb971334892574f5a646882cd41474c041ea516"}
Jul 14 07:50:09.055143 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.054671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lhd7p" event={"ID":"4470a571-3e6e-4281-9e42-dbc7ed28ab42","Type":"ContainerStarted","Data":"6c7c760a0cbad3c945d1aceaf590388ab408b5540d9c97932d5100ba3547d2f1"}
Jul 14 07:50:09.069349 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.069260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal" event={"ID":"45a109eebdae577f01fcda859fc8c61c","Type":"ContainerStarted","Data":"f555f6443a0372152aae320fff095a72ff4a2c165a41e03ad29dace784a817e1"}
Jul 14 07:50:09.085958 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.085918    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa849f63d6070118ce2c0ebb1cff75f1" containerID="1977858aa61a8eb3a7fa9f2284a105af8ddbe1835615369f05d742f531a792b2" exitCode=0
Jul 14 07:50:09.086657 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.086627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal" event={"ID":"aa849f63d6070118ce2c0ebb1cff75f1","Type":"ContainerDied","Data":"1977858aa61a8eb3a7fa9f2284a105af8ddbe1835615369f05d742f531a792b2"}
Jul 14 07:50:09.095133 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.095078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8g8g8" event={"ID":"bd3b864f-7006-4e05-a4f3-8dd121a27827","Type":"ContainerStarted","Data":"396376be481a3d9460112334cd024ff1847ae3120d9f0f971c5d8096f34b54c2"}
Jul 14 07:50:09.103465 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.103346    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-251.ec2.internal" podStartSLOduration=3.103322339 podStartE2EDuration="3.103322339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:09.085716502 +0000 UTC m=+4.664722849" watchObservedRunningTime="2026-07-14 07:50:09.103322339 +0000 UTC m=+4.682328684"
Jul 14 07:50:09.115895 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.115811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lxhqb" event={"ID":"b93824ee-53c0-4eec-a3d3-88bc418d6e86","Type":"ContainerStarted","Data":"e49685aadb6da925481bf324d61db21806243afa164eab3a76a96b7581e6f55d"}
Jul 14 07:50:09.979786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:09.979036    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:09.979786 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:09.979280    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:10.151718 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:10.151596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal" event={"ID":"aa849f63d6070118ce2c0ebb1cff75f1","Type":"ContainerStarted","Data":"1ff83efc9741fb1065efc564505f8a831912c5643cdc03988b601ded51856038"}
Jul 14 07:50:10.446097 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:10.445994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:10.446306 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.446209    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:10.446306 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.446285    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs podName:0ed038c2-74e2-4ce0-bbdd-206378df7c25 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.446263949 +0000 UTC m=+10.025270294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs") pod "network-metrics-daemon-wswkj" (UID: "0ed038c2-74e2-4ce0-bbdd-206378df7c25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:10.546549 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:10.546510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:10.546734 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.546715    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:10.546813 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.546787    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret podName:3848661b-bad6-4761-9823-1d213895ab2a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.546767949 +0000 UTC m=+10.125774269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret") pod "global-pull-secret-syncer-hz6wd" (UID: "3848661b-bad6-4761-9823-1d213895ab2a") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:10.647829 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:10.647391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:10.647829 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.647626    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:50:10.647829 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.647651    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:50:10.647829 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.647666    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8pnsw for pod openshift-network-diagnostics/network-check-target-vkrgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:10.647829 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.647730    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw podName:998ec576-9e5f-4dc6-bf7e-aa4e0e658436 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:14.647710054 +0000 UTC m=+10.226716388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pnsw" (UniqueName: "kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw") pod "network-check-target-vkrgz" (UID: "998ec576-9e5f-4dc6-bf7e-aa4e0e658436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:10.979534 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:10.979490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:10.979738 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.979639    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:10.983004 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:10.982973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:10.983488 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:10.983134    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:11.980092 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:11.980053    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:11.980277 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:11.980208    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:12.980869 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:12.980132    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:12.980869 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:12.980265    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:12.980869 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:12.980677    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:12.980869 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:12.980773    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:13.980213 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:13.979656    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:13.980213 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:13.979818    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:14.479956 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:14.479785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:14.480399 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.479959    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:14.480399 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.480052    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs podName:0ed038c2-74e2-4ce0-bbdd-206378df7c25 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:22.480012873 +0000 UTC m=+18.059019197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs") pod "network-metrics-daemon-wswkj" (UID: "0ed038c2-74e2-4ce0-bbdd-206378df7c25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:14.580859 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:14.580820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:14.581055 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.580964    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:14.581055 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.581052    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret podName:3848661b-bad6-4761-9823-1d213895ab2a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:22.581016136 +0000 UTC m=+18.160022454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret") pod "global-pull-secret-syncer-hz6wd" (UID: "3848661b-bad6-4761-9823-1d213895ab2a") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:14.681562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:14.681511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:14.681749 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.681727    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:50:14.681810 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.681757    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:50:14.681810 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.681772    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8pnsw for pod openshift-network-diagnostics/network-check-target-vkrgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:14.681914 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.681838    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw podName:998ec576-9e5f-4dc6-bf7e-aa4e0e658436 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:22.681818845 +0000 UTC m=+18.260825178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pnsw" (UniqueName: "kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw") pod "network-check-target-vkrgz" (UID: "998ec576-9e5f-4dc6-bf7e-aa4e0e658436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:14.981458 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:14.980807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:14.981458 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.980917    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:14.981458 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:14.981315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:14.981458 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:14.981412    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:15.979279 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:15.979245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:15.979716 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:15.979390    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:16.980309 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:16.980026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:16.980309 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:16.980183    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:16.980309 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:16.980244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:16.980875 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:16.980568    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:17.979417 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:17.979382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:17.979609 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:17.979519    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:18.981626 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:18.981597    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:18.982002 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:18.981693    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:18.982002 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:18.981719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:18.982002 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:18.981763    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:19.979552 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:19.979515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:19.979735 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:19.979667    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:20.979415 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:20.979364    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:20.979828 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:20.979420    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:20.979828 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:20.979497    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:20.979828 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:20.979626    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:21.979107 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:21.979069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:21.979293 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:21.979238    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:22.540663 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:22.540627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:22.541124 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.540795    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:22.541124 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.540875    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs podName:0ed038c2-74e2-4ce0-bbdd-206378df7c25 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:38.540851129 +0000 UTC m=+34.119857451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs") pod "network-metrics-daemon-wswkj" (UID: "0ed038c2-74e2-4ce0-bbdd-206378df7c25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:22.641851 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:22.641824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:22.642015 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.641958    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:22.642091 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.642018    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret podName:3848661b-bad6-4761-9823-1d213895ab2a nodeName:}" failed. No retries permitted until 2026-07-14 07:50:38.642003623 +0000 UTC m=+34.221009943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret") pod "global-pull-secret-syncer-hz6wd" (UID: "3848661b-bad6-4761-9823-1d213895ab2a") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:22.742360 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:22.742324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:22.742524 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.742455    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:50:22.742524 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.742473    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:50:22.742524 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.742484    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8pnsw for pod openshift-network-diagnostics/network-check-target-vkrgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:22.742683 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.742536    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw podName:998ec576-9e5f-4dc6-bf7e-aa4e0e658436 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:38.742523212 +0000 UTC m=+34.321529529 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pnsw" (UniqueName: "kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw") pod "network-check-target-vkrgz" (UID: "998ec576-9e5f-4dc6-bf7e-aa4e0e658436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:22.981849 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:22.981775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:22.982014 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:22.981775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:22.982014 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.981901    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:22.982014 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:22.981957    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:23.979185 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:23.979144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:23.979569 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:23.979292    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:24.980633 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:24.980596    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:24.981020 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:24.980691    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:24.981020 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:24.980753    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:24.981020 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:24.980867    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:25.979052 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:25.978990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:25.979231 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:25.979135    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:26.979422 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:26.979382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:26.979422 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:26.979409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:26.980029 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:26.979524    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:26.980029 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:26.979630    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:27.979571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:27.979176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:27.980317 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:27.979664    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:28.198080 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.197978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8g8g8" event={"ID":"bd3b864f-7006-4e05-a4f3-8dd121a27827","Type":"ContainerStarted","Data":"27ff28229f062309bb18296224681669f43b260a26e9474c07b01584d1c3f04c"}
Jul 14 07:50:28.200613 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.200591    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 07:50:28.200900 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.200880    2579 generic.go:356] "Generic (PLEG): container finished" podID="99e14a82-88d7-406f-8f8a-3bd65351cae7" containerID="d4291e6f84c532b0e3ff49d60d40b81879f00bcc067bd563bdbb742518f35928" exitCode=1
Jul 14 07:50:28.200973 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.200957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"4771c416d4db51221842397fd8d7af7ba4dacc121064b7a8c3d608e131baad60"}
Jul 14 07:50:28.201057 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.201026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"79ffc47fe77d53e11c6e2d0fb961f440bb2b8bacc08ee64afeca6885be48c21f"}
Jul 14 07:50:28.201094 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.201079    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"9ac3d254f0c42efb34fe23e0ec0a3edf958c235624bb3b25a9ea72386f515845"}
Jul 14 07:50:28.201137 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.201119    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"4942ccd8eea10379980fd8fb22539bd9afa903e9e9252c27cc549f58bcb9980e"}
Jul 14 07:50:28.201180 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.201156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerDied","Data":"d4291e6f84c532b0e3ff49d60d40b81879f00bcc067bd563bdbb742518f35928"}
Jul 14 07:50:28.201239 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.201204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"956981372ff8ecca10d015175a8444e7c2853e25f84f4fc66b3b9c1f0c2d120d"}
Jul 14 07:50:28.202298 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.202280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c9r5l" event={"ID":"d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc","Type":"ContainerStarted","Data":"01d54ebafe73aa91236dc6179b28b6f9c6edad36ba07a0701647328c99652bed"}
Jul 14 07:50:28.203566 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.203544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lxsbq" event={"ID":"36aaafad-3048-4a70-8bb8-4e27405222f0","Type":"ContainerStarted","Data":"c6a50edb9197f68c2a6379329195c09f706446f1f428e5ca8caec9e4537535bc"}
Jul 14 07:50:28.204876 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.204859    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb" event={"ID":"eae2e531-478b-4e27-8a59-579380fe0d4c","Type":"ContainerStarted","Data":"8811befc8d71721c1e6d500974478f7470481ce602e0557dddfecca90e81a2af"}
Jul 14 07:50:28.206256 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.206235    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k429w" event={"ID":"7f101914-c17b-49ee-bb14-c7d8817badeb","Type":"ContainerStarted","Data":"7d4af1c0da046381822e3a1d3945b81dc633633fd2db5dbd51143fd386801c92"}
Jul 14 07:50:28.207478 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.207461    2579 generic.go:356] "Generic (PLEG): container finished" podID="6319dcc6-4314-441a-a84b-bfcb62468c2b" containerID="13b9df4b78334c0278824d1be809ff413080749e43c875a2eea83181771131ce" exitCode=0
Jul 14 07:50:28.207566 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.207524    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" event={"ID":"6319dcc6-4314-441a-a84b-bfcb62468c2b","Type":"ContainerDied","Data":"13b9df4b78334c0278824d1be809ff413080749e43c875a2eea83181771131ce"}
Jul 14 07:50:28.208863 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.208846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lhd7p" event={"ID":"4470a571-3e6e-4281-9e42-dbc7ed28ab42","Type":"ContainerStarted","Data":"42caa7ba7b94870f4d886e50911901a29b989bcac6c223366862daf81afd1d0c"}
Jul 14 07:50:28.215480 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.215444    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-251.ec2.internal" podStartSLOduration=22.215431654 podStartE2EDuration="22.215431654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:10.168450414 +0000 UTC m=+5.747456758" watchObservedRunningTime="2026-07-14 07:50:28.215431654 +0000 UTC m=+23.794438025"
Jul 14 07:50:28.230588 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.230545    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lhd7p" podStartSLOduration=4.246569757 podStartE2EDuration="23.23053059s" totalImagesPullingTime="18.983960833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:28.230526141 +0000 UTC m=+23.809532479" watchObservedRunningTime="2026-07-14 07:50:28.23053059 +0000 UTC m=+23.809536928"
Jul 14 07:50:28.231216 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.231160    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8g8g8" podStartSLOduration=4.28605322 podStartE2EDuration="23.231146298s" totalImagesPullingTime="18.945093078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:28.21513263 +0000 UTC m=+23.794138970" watchObservedRunningTime="2026-07-14 07:50:28.231146298 +0000 UTC m=+23.810152632"
Jul 14 07:50:28.248333 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.248285    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lxsbq" podStartSLOduration=4.241118489 podStartE2EDuration="23.248270361s" totalImagesPullingTime="19.007151872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:28.248111555 +0000 UTC m=+23.827117889" watchObservedRunningTime="2026-07-14 07:50:28.248270361 +0000 UTC m=+23.827276701"
Jul 14 07:50:28.264455 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.264403    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k429w" podStartSLOduration=4.281700026 podStartE2EDuration="23.264391797s" totalImagesPullingTime="18.982691771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:28.263855745 +0000 UTC m=+23.842862084" watchObservedRunningTime="2026-07-14 07:50:28.264391797 +0000 UTC m=+23.843398163"
Jul 14 07:50:28.674259 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.674229    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 07:50:28.719348 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.719257    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:28.871240 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.871118    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T07:50:28.674251418Z","UUID":"e185470e-eab3-4953-b166-b6d998d59bb5","Handler":null,"Name":"","Endpoint":""}
Jul 14 07:50:28.872849 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.872821    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 07:50:28.872983 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.872867    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 07:50:28.924765 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.924736    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:28.980011 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.979924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:28.980482 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:28.979924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:28.980482 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:28.980083    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:28.980482 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:28.980112    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:29.025224 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.025177    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:29.214088 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.214049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lxhqb" event={"ID":"b93824ee-53c0-4eec-a3d3-88bc418d6e86","Type":"ContainerStarted","Data":"56a9a6cbc2712407130374a6a37748c2a319f5818c143ef30194d1a18c31ac18"}
Jul 14 07:50:29.216732 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.216700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb" event={"ID":"eae2e531-478b-4e27-8a59-579380fe0d4c","Type":"ContainerStarted","Data":"21c301ed019ce1351827a9861bc9989cb819a65aab9a85dbb9cc598399c091d5"}
Jul 14 07:50:29.230581 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.230460    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c9r5l" podStartSLOduration=5.293986515 podStartE2EDuration="24.230439162s" totalImagesPullingTime="18.936452647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:28.306210994 +0000 UTC m=+23.885217334" watchObservedRunningTime="2026-07-14 07:50:29.230439162 +0000 UTC m=+24.809445502"
Jul 14 07:50:29.231378 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.231336    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lxhqb" podStartSLOduration=5.261225896 podStartE2EDuration="24.231325733s" totalImagesPullingTime="18.970099837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:29.230348822 +0000 UTC m=+24.809355165" watchObservedRunningTime="2026-07-14 07:50:29.231325733 +0000 UTC m=+24.810332072"
Jul 14 07:50:29.315292 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.315245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:29.381347 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.381303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:29.510241 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.510155    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:29.620993 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.620960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:29.980131 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:29.979928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:29.980539 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:29.980275    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:30.111466 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.111422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:30.222562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.222540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 07:50:30.222974 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.222943    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"7a2c97fae244f0c51b171046090bd9b93d69cf8e5ba7d9ea1b4c91fbb9d86f31"}
Jul 14 07:50:30.225363 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.225329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb" event={"ID":"eae2e531-478b-4e27-8a59-579380fe0d4c","Type":"ContainerStarted","Data":"4bbc7577c3f217271454bba41e6886f396247ff67cff66e651ab32857a32f22b"}
Jul 14 07:50:30.242743 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.242681    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgnqb" podStartSLOduration=4.066380204 podStartE2EDuration="25.242664039s" totalImagesPullingTime="21.176283835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:30.242236827 +0000 UTC m=+25.821243181" watchObservedRunningTime="2026-07-14 07:50:30.242664039 +0000 UTC m=+25.821670377"
Jul 14 07:50:30.318703 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.318614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:30.519107 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.519068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:30.618619 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.618545    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:30.919717 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.919631    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:30.980011 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.979973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:30.980011 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:30.979971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:30.980659 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:30.980126    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:30.980659 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:30.980253    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:31.314091 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:31.313994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:31.371550 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:31.371516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:31.499763 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:31.499722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:31.568598 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:31.568520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:31.644295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:31.644249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:31.731747 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:31.731718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:31.918514 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:31.918436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:31.979623 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:31.979584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:31.979804 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:31.979713    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:32.022775 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.022742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:32.119376 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.119349    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:32.139436 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.139408    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:32.140200 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.140180    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:32.234381 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.234336    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 07:50:32.234886 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.234752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"2a4a69b5494e2a04c5a535b449e4aecb155980f84115575b79b297440f5a1180"}
Jul 14 07:50:32.235314 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.235299    2579 scope.go:117] "RemoveContainer" containerID="d4291e6f84c532b0e3ff49d60d40b81879f00bcc067bd563bdbb742518f35928"
Jul 14 07:50:32.235368 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.235330    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:32.236192 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.235897    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8g8g8"
Jul 14 07:50:32.313755 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.313421    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:32.907236 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.907144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:32.979535 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.979492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:32.979708 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:32.979632    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:32.979708 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:32.979676    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:32.979783 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:32.979768    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:33.007981 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.007946    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:33.238921 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.238829    2579 generic.go:356] "Generic (PLEG): container finished" podID="6319dcc6-4314-441a-a84b-bfcb62468c2b" containerID="675d939c9dcf012ebba2febca380cae8ac859b773c86b32f1e9cbd8f6ed5e0c5" exitCode=0
Jul 14 07:50:33.239616 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.238911    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" event={"ID":"6319dcc6-4314-441a-a84b-bfcb62468c2b","Type":"ContainerDied","Data":"675d939c9dcf012ebba2febca380cae8ac859b773c86b32f1e9cbd8f6ed5e0c5"}
Jul 14 07:50:33.242685 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.242669    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 07:50:33.243083 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.243057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" event={"ID":"99e14a82-88d7-406f-8f8a-3bd65351cae7","Type":"ContainerStarted","Data":"66331a19b236b53d9091eb704fbee197d9a162546f6096b7a0fec53834029519"}
Jul 14 07:50:33.243300 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.243267    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:33.243397 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.243360    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:33.243466 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.243412    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:33.259432 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.259407    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:33.259577 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.259569    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:50:33.294440 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.294391    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz" podStartSLOduration=9.26831361 podStartE2EDuration="28.294376403s" totalImagesPullingTime="19.026062793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:33.293124207 +0000 UTC m=+28.872130542" watchObservedRunningTime="2026-07-14 07:50:33.294376403 +0000 UTC m=+28.873382742"
Jul 14 07:50:33.319176 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.319140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:33.722349 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.722273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:33.914629 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.914600    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:33.979411 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:33.979340    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:33.979605 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:33.979454    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:34.509213 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:34.509131    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:34.910458 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:34.910370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:34.980966 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:34.980930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:34.981144 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:34.981095    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:34.981204 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:34.981186    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:34.981249 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:34.981089    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:35.251846 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:35.251767    2579 generic.go:356] "Generic (PLEG): container finished" podID="6319dcc6-4314-441a-a84b-bfcb62468c2b" containerID="5f0b462a36de319f77a508124ad12a6233d0c020da281b04470d4679aa3276c6" exitCode=0
Jul 14 07:50:35.251999 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:35.251854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" event={"ID":"6319dcc6-4314-441a-a84b-bfcb62468c2b","Type":"ContainerDied","Data":"5f0b462a36de319f77a508124ad12a6233d0c020da281b04470d4679aa3276c6"}
Jul 14 07:50:35.318707 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:35.318677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:35.522799 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:35.522721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:35.907750 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:35.907676    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:35.979326 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:35.979292    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:35.979499 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:35.979407    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:36.512226 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:36.512138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:36.909333 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:36.909248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:36.979513 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:36.979480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:36.979681 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:36.979479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:36.979681 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:36.979615    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:36.979681 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:36.979665    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:37.110809 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:37.110779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:37.259506 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:37.259427    2579 generic.go:356] "Generic (PLEG): container finished" podID="6319dcc6-4314-441a-a84b-bfcb62468c2b" containerID="cb7850e54a6fc19ae53529a26c273288174f898ee4c9c546b901530f912c741e" exitCode=0
Jul 14 07:50:37.259506 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:37.259477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" event={"ID":"6319dcc6-4314-441a-a84b-bfcb62468c2b","Type":"ContainerDied","Data":"cb7850e54a6fc19ae53529a26c273288174f898ee4c9c546b901530f912c741e"}
Jul 14 07:50:37.312376 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:37.312338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:37.979237 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:37.979202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:37.979705 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:37.979348    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:38.569890 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:38.569705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:38.569890 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.569858    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:38.570114 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.569950    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs podName:0ed038c2-74e2-4ce0-bbdd-206378df7c25 nodeName:}" failed. No retries permitted until 2026-07-14 07:51:10.569934148 +0000 UTC m=+66.148940464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs") pod "network-metrics-daemon-wswkj" (UID: "0ed038c2-74e2-4ce0-bbdd-206378df7c25") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 07:50:38.670563 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:38.670529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:38.670736 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.670640    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:38.670736 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.670694    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret podName:3848661b-bad6-4761-9823-1d213895ab2a nodeName:}" failed. No retries permitted until 2026-07-14 07:51:10.670681342 +0000 UTC m=+66.249687659 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret") pod "global-pull-secret-syncer-hz6wd" (UID: "3848661b-bad6-4761-9823-1d213895ab2a") : object "kube-system"/"original-pull-secret" not registered
Jul 14 07:50:38.762591 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:38.762555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:38.771674 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:38.771631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:38.771856 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.771754    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 07:50:38.771856 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.771774    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 07:50:38.771856 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.771786    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8pnsw for pod openshift-network-diagnostics/network-check-target-vkrgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:38.771856 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.771848    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw podName:998ec576-9e5f-4dc6-bf7e-aa4e0e658436 nodeName:}" failed. No retries permitted until 2026-07-14 07:51:10.771829076 +0000 UTC m=+66.350835394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pnsw" (UniqueName: "kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw") pod "network-check-target-vkrgz" (UID: "998ec576-9e5f-4dc6-bf7e-aa4e0e658436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 07:50:38.865595 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:38.865508    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:38.982937 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:38.982910    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:38.982937 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:38.982934    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:38.983392 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.983013    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:38.983392 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:38.983137    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:39.041402 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:39.041368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:39.101766 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:39.101726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:39.244358 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:39.244273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:39.301426 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:39.301381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:39.634201 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:39.634105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:39.694625 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:39.694591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:39.979023 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:39.978945    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:39.979207 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:39.979117    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:40.456335 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:40.456255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:40.643843 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:40.643809    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:40.859450 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:40.859357    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:40.980145 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:40.980111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:40.980326 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:40.980161    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:40.980326 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:40.980237    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:40.980409 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:40.980350    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:41.120619 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:41.120528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:41.979639 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:41.979607    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:41.980129 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:41.979743    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:42.274808 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:42.274730    2579 generic.go:356] "Generic (PLEG): container finished" podID="6319dcc6-4314-441a-a84b-bfcb62468c2b" containerID="7ba3ff7b977d4bdddcb1c5d981c4d361f2454b11be7cc81a5c4353ef70645409" exitCode=0
Jul 14 07:50:42.274808 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:42.274804    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" event={"ID":"6319dcc6-4314-441a-a84b-bfcb62468c2b","Type":"ContainerDied","Data":"7ba3ff7b977d4bdddcb1c5d981c4d361f2454b11be7cc81a5c4353ef70645409"}
Jul 14 07:50:42.979825 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:42.979781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:42.980304 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:42.979837    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:42.980304 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:42.979899    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:42.980304 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:42.980051    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:43.280099 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:43.279995    2579 generic.go:356] "Generic (PLEG): container finished" podID="6319dcc6-4314-441a-a84b-bfcb62468c2b" containerID="2df0febb4d502d933fbc7495b5f08aeedae878ac44904d65e8f4648889f92000" exitCode=0
Jul 14 07:50:43.280099 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:43.280075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" event={"ID":"6319dcc6-4314-441a-a84b-bfcb62468c2b","Type":"ContainerDied","Data":"2df0febb4d502d933fbc7495b5f08aeedae878ac44904d65e8f4648889f92000"}
Jul 14 07:50:43.979945 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:43.979916    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:43.980334 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:43.980014    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:44.284667 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:44.284584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" event={"ID":"6319dcc6-4314-441a-a84b-bfcb62468c2b","Type":"ContainerStarted","Data":"3caf21072198ba2d4de40ec6bd8a9f7a5c226a0edafc02aaed6f09d494f41b1a"}
Jul 14 07:50:44.307428 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:44.307379    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jdq6p" podStartSLOduration=10.338762865 podStartE2EDuration="39.307364497s" totalImagesPullingTime="28.968601632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:44.306789403 +0000 UTC m=+39.885795747" watchObservedRunningTime="2026-07-14 07:50:44.307364497 +0000 UTC m=+39.886370835"
Jul 14 07:50:44.459885 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:44.459856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:44.514370 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:44.514338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:44.972883 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:44.972853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:44.982058 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:44.982003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:44.982058 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:44.982022    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:44.982624 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:44.982130    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:44.982624 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:44.982243    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:45.085671 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:45.085630    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:45.186956 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:45.186914    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:45.285544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:45.285450    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:45.385598 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:45.385563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:45.907151 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:45.906722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:45.979431 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:45.979394    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:45.979588 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:45.979546    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:46.006791 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.006756    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:46.124132 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.124098    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hz6wd"]
Jul 14 07:50:46.124315 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.124221    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:46.124391 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:46.124359    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:46.126548 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.126516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wswkj"]
Jul 14 07:50:46.139322 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.139288    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vkrgz"]
Jul 14 07:50:46.139663 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.139646    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:46.139911 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:46.139888    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:46.289592 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.289517    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:46.289727 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:46.289657    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:46.306525 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.306501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:46.364190 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.364158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:46.480612 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.480581    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:46.535397 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:46.535367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:47.675311 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:47.675284    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:47.753069 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:47.753023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:47.829594 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:47.829563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:47.979390 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:47.979356    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:47.979558 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:47.979454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:47.979558 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:47.979462    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:47.979558 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:47.979485    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:47.979662 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:47.979557    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:47.979662 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:47.979617    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:48.337818 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:48.337738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:48.441345 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:48.441316    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:48.721728 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:48.721535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:48.784182 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:48.784148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:49.979214 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:49.979182    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:49.979587 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:49.979225    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:49.979587 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:49.979310    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:49.979587 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:49.979323    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hz6wd" podUID="3848661b-bad6-4761-9823-1d213895ab2a"
Jul 14 07:50:49.979587 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:49.979386    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wswkj" podUID="0ed038c2-74e2-4ce0-bbdd-206378df7c25"
Jul 14 07:50:49.979587 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:50:49.979428    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkrgz" podUID="998ec576-9e5f-4dc6-bf7e-aa4e0e658436"
Jul 14 07:50:49.987948 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:49.987918    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:50.040016 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.039917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:50.170404 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.170378    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-251.ec2.internal" event="NodeReady"
Jul 14 07:50:50.170564 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.170510    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 07:50:50.218070 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.217990    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4wjks"]
Jul 14 07:50:50.232427 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.232338    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.232427 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.232336    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4lcn5"]
Jul 14 07:50:50.237204 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.236626    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 07:50:50.237786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.237495    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lxlt\""
Jul 14 07:50:50.237786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.237622    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 07:50:50.244496 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.244476    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4lcn5"]
Jul 14 07:50:50.244586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.244504    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4wjks"]
Jul 14 07:50:50.244586 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.244528    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xc8pq"]
Jul 14 07:50:50.244650 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.244582    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4lcn5"
Jul 14 07:50:50.247305 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.247278    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 07:50:50.247417 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.247332    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 07:50:50.247417 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.247362    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5nzm8\""
Jul 14 07:50:50.247417 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.247338    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 07:50:50.263012 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.262985    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xc8pq"]
Jul 14 07:50:50.263180 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.263106    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.265997 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.265972    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 07:50:50.266152 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.265973    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 07:50:50.266152 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.266014    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zq59h\""
Jul 14 07:50:50.266152 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.266009    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 07:50:50.266152 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.266017    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 07:50:50.355278 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.355183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77515c6b-3d33-45f1-b182-b1f8e989171d-tmp-dir\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.355278 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.355226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77515c6b-3d33-45f1-b182-b1f8e989171d-config-volume\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.355278 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.355250    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9k9f\" (UniqueName: \"kubernetes.io/projected/d55506b5-72dd-4f10-95bc-2abba901d2fa-kube-api-access-g9k9f\") pod \"ingress-canary-4lcn5\" (UID: \"d55506b5-72dd-4f10-95bc-2abba901d2fa\") " pod="openshift-ingress-canary/ingress-canary-4lcn5"
Jul 14 07:50:50.355538 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.355307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77515c6b-3d33-45f1-b182-b1f8e989171d-metrics-tls\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.355538 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.355334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plrmg\" (UniqueName: \"kubernetes.io/projected/77515c6b-3d33-45f1-b182-b1f8e989171d-kube-api-access-plrmg\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.355538 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.355385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55506b5-72dd-4f10-95bc-2abba901d2fa-cert\") pod \"ingress-canary-4lcn5\" (UID: \"d55506b5-72dd-4f10-95bc-2abba901d2fa\") " pod="openshift-ingress-canary/ingress-canary-4lcn5"
Jul 14 07:50:50.379810 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.379781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:50.456489 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55506b5-72dd-4f10-95bc-2abba901d2fa-cert\") pod \"ingress-canary-4lcn5\" (UID: \"d55506b5-72dd-4f10-95bc-2abba901d2fa\") " pod="openshift-ingress-canary/ingress-canary-4lcn5"
Jul 14 07:50:50.456705 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68265154-53df-4b2e-94da-11819b064085-data-volume\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.456705 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68265154-53df-4b2e-94da-11819b064085-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.456705 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77515c6b-3d33-45f1-b182-b1f8e989171d-tmp-dir\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.456705 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77515c6b-3d33-45f1-b182-b1f8e989171d-config-volume\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.456705 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9k9f\" (UniqueName: \"kubernetes.io/projected/d55506b5-72dd-4f10-95bc-2abba901d2fa-kube-api-access-g9k9f\") pod \"ingress-canary-4lcn5\" (UID: \"d55506b5-72dd-4f10-95bc-2abba901d2fa\") " pod="openshift-ingress-canary/ingress-canary-4lcn5"
Jul 14 07:50:50.456705 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68265154-53df-4b2e-94da-11819b064085-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.456976 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77515c6b-3d33-45f1-b182-b1f8e989171d-metrics-tls\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.456976 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68265154-53df-4b2e-94da-11819b064085-crio-socket\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.456976 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plrmg\" (UniqueName: \"kubernetes.io/projected/77515c6b-3d33-45f1-b182-b1f8e989171d-kube-api-access-plrmg\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.456976 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbqdq\" (UniqueName: \"kubernetes.io/projected/68265154-53df-4b2e-94da-11819b064085-kube-api-access-lbqdq\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.456976 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.456916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77515c6b-3d33-45f1-b182-b1f8e989171d-tmp-dir\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.457291 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.457268    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77515c6b-3d33-45f1-b182-b1f8e989171d-config-volume\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.460339 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.460317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77515c6b-3d33-45f1-b182-b1f8e989171d-metrics-tls\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.460443 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.460383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d55506b5-72dd-4f10-95bc-2abba901d2fa-cert\") pod \"ingress-canary-4lcn5\" (UID: \"d55506b5-72dd-4f10-95bc-2abba901d2fa\") " pod="openshift-ingress-canary/ingress-canary-4lcn5"
Jul 14 07:50:50.464759 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.464738    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plrmg\" (UniqueName: \"kubernetes.io/projected/77515c6b-3d33-45f1-b182-b1f8e989171d-kube-api-access-plrmg\") pod \"dns-default-4wjks\" (UID: \"77515c6b-3d33-45f1-b182-b1f8e989171d\") " pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.464951 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.464926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9k9f\" (UniqueName: \"kubernetes.io/projected/d55506b5-72dd-4f10-95bc-2abba901d2fa-kube-api-access-g9k9f\") pod \"ingress-canary-4lcn5\" (UID: \"d55506b5-72dd-4f10-95bc-2abba901d2fa\") " pod="openshift-ingress-canary/ingress-canary-4lcn5"
Jul 14 07:50:50.480138 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.480111    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:50.545196 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.545158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:50.553296 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.553267    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4lcn5"
Jul 14 07:50:50.557546 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.557527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqdq\" (UniqueName: \"kubernetes.io/projected/68265154-53df-4b2e-94da-11819b064085-kube-api-access-lbqdq\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.557605 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.557583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68265154-53df-4b2e-94da-11819b064085-data-volume\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.557648 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.557602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68265154-53df-4b2e-94da-11819b064085-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.557648 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.557634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68265154-53df-4b2e-94da-11819b064085-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.557737 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.557653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68265154-53df-4b2e-94da-11819b064085-crio-socket\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.557811 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.557798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68265154-53df-4b2e-94da-11819b064085-crio-socket\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.557931 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.557910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68265154-53df-4b2e-94da-11819b064085-data-volume\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.558168 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.558151    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68265154-53df-4b2e-94da-11819b064085-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.559945 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.559921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68265154-53df-4b2e-94da-11819b064085-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.566208 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.566190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqdq\" (UniqueName: \"kubernetes.io/projected/68265154-53df-4b2e-94da-11819b064085-kube-api-access-lbqdq\") pod \"insights-runtime-extractor-xc8pq\" (UID: \"68265154-53df-4b2e-94da-11819b064085\") " pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.572206 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.572183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xc8pq"
Jul 14 07:50:50.753579 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.753548    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4lcn5"]
Jul 14 07:50:50.756574 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.756443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4wjks"]
Jul 14 07:50:50.759623 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:50.759594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55506b5_72dd_4f10_95bc_2abba901d2fa.slice/crio-e2942ee6a83ef5d7e72ddeaf9cf94b3a9a75f3e8990e7f455ec1c9ffaf534f49 WatchSource:0}: Error finding container e2942ee6a83ef5d7e72ddeaf9cf94b3a9a75f3e8990e7f455ec1c9ffaf534f49: Status 404 returned error can't find the container with id e2942ee6a83ef5d7e72ddeaf9cf94b3a9a75f3e8990e7f455ec1c9ffaf534f49
Jul 14 07:50:50.760466 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:50.760435    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77515c6b_3d33_45f1_b182_b1f8e989171d.slice/crio-5edd0e30edd700875d18a1758713a5b836a283bce85eb8967295c00893af1e84 WatchSource:0}: Error finding container 5edd0e30edd700875d18a1758713a5b836a283bce85eb8967295c00893af1e84: Status 404 returned error can't find the container with id 5edd0e30edd700875d18a1758713a5b836a283bce85eb8967295c00893af1e84
Jul 14 07:50:50.769633 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:50.769560    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xc8pq"]
Jul 14 07:50:50.774276 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:50.774251    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68265154_53df_4b2e_94da_11819b064085.slice/crio-e2b7124502d3bf59bf0406fa16bff275e698b2835c0144b6d981fd4d582a34e1 WatchSource:0}: Error finding container e2b7124502d3bf59bf0406fa16bff275e698b2835c0144b6d981fd4d582a34e1: Status 404 returned error can't find the container with id e2b7124502d3bf59bf0406fa16bff275e698b2835c0144b6d981fd4d582a34e1
Jul 14 07:50:51.273381 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.273333    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:51.303701 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.303648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xc8pq" event={"ID":"68265154-53df-4b2e-94da-11819b064085","Type":"ContainerStarted","Data":"e2b7124502d3bf59bf0406fa16bff275e698b2835c0144b6d981fd4d582a34e1"}
Jul 14 07:50:51.304940 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.304917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4lcn5" event={"ID":"d55506b5-72dd-4f10-95bc-2abba901d2fa","Type":"ContainerStarted","Data":"e2942ee6a83ef5d7e72ddeaf9cf94b3a9a75f3e8990e7f455ec1c9ffaf534f49"}
Jul 14 07:50:51.306089 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.306057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wjks" event={"ID":"77515c6b-3d33-45f1-b182-b1f8e989171d","Type":"ContainerStarted","Data":"5edd0e30edd700875d18a1758713a5b836a283bce85eb8967295c00893af1e84"}
Jul 14 07:50:51.333190 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.333123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:51.979856 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.979821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:50:51.980328 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.980311    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:50:51.980752 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.980736    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:50:51.983206 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.983182    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 07:50:51.983841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.983545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 07:50:51.985691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.984666    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjcpw\""
Jul 14 07:50:51.985691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.984904    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 07:50:51.985691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.985164    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skvf2\""
Jul 14 07:50:51.985691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:51.985399    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 07:50:53.466723 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:53.466626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:53.522686 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:53.522652    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:53.984193 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:53.984165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:54.042006 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:54.041977    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:55.295919 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:55.295667    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:55.354165 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:55.354129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:56.872714 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.870228    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8697bdc78d-m8tbw"]
Jul 14 07:50:56.882836 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.882807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8697bdc78d-m8tbw"]
Jul 14 07:50:56.882956 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.882935    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:56.886107 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.886081    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 07:50:56.887172 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.886671    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 07:50:56.887172 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.886732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xjbc6\""
Jul 14 07:50:56.887737 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.887562    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 07:50:56.887737 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.887562    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 07:50:56.887737 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.887604    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 07:50:56.887926 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.887875    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 07:50:56.888013 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.887988    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 07:50:56.893292 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.893270    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 07:50:56.906766 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.906737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-trusted-ca-bundle\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:56.906864 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.906798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-serving-cert\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:56.906864 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.906826    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-service-ca\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:56.906864 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.906843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkhfq\" (UniqueName: \"kubernetes.io/projected/4782a79e-8c10-45dc-bf89-e46d3855a7e8-kube-api-access-jkhfq\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:56.906988 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.906880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-oauth-config\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:56.906988 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.906914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-config\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:56.906988 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:56.906930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-oauth-serving-cert\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.007888 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.007854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-service-ca\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.007888 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.007892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkhfq\" (UniqueName: \"kubernetes.io/projected/4782a79e-8c10-45dc-bf89-e46d3855a7e8-kube-api-access-jkhfq\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.008150 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.007955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-oauth-config\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.008150 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.007976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-config\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.008150 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.007996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-oauth-serving-cert\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.008282 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.008149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-trusted-ca-bundle\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.008282 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.008213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-serving-cert\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.008690 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.008661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-service-ca\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.009212 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.009186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-oauth-serving-cert\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.009798 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.009638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-config\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.010694 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.010667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-trusted-ca-bundle\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.012280 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.012219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-serving-cert\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.012280 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.012223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-oauth-config\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.016029 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.016001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkhfq\" (UniqueName: \"kubernetes.io/projected/4782a79e-8c10-45dc-bf89-e46d3855a7e8-kube-api-access-jkhfq\") pod \"console-8697bdc78d-m8tbw\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") " pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.203003 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.202955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:50:57.324762 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.324554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xc8pq" event={"ID":"68265154-53df-4b2e-94da-11819b064085","Type":"ContainerStarted","Data":"6ccf404a073a44d48f7f36f7edb2326182cdd1457f550b2984d95657986b40ed"}
Jul 14 07:50:57.326213 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.326183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4lcn5" event={"ID":"d55506b5-72dd-4f10-95bc-2abba901d2fa","Type":"ContainerStarted","Data":"6d1c83ee490812d48fdeb7979f910c94b1f9642d5feddcb9093a95eadf8b3af6"}
Jul 14 07:50:57.328149 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.328121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wjks" event={"ID":"77515c6b-3d33-45f1-b182-b1f8e989171d","Type":"ContainerStarted","Data":"4813510bf73454e78c489a93938fbebe98bc069a70a48638108a0d552dba8f87"}
Jul 14 07:50:57.328267 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.328169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wjks" event={"ID":"77515c6b-3d33-45f1-b182-b1f8e989171d","Type":"ContainerStarted","Data":"e920ab8c5ae5c5ece65b1bffb4fc9256279237d5bbfd102dfd5948700d7ac478"}
Jul 14 07:50:57.328267 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.328204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4wjks"
Jul 14 07:50:57.343931 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.343786    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4lcn5" podStartSLOduration=1.2704817990000001 podStartE2EDuration="7.343768252s" totalImagesPullingTime="6.073286453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:57.343215469 +0000 UTC m=+52.922221808" watchObservedRunningTime="2026-07-14 07:50:57.343768252 +0000 UTC m=+52.922774636"
Jul 14 07:50:57.345160 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.345137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8697bdc78d-m8tbw"]
Jul 14 07:50:57.348183 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:50:57.348150    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4782a79e_8c10_45dc_bf89_e46d3855a7e8.slice/crio-a287957c9eec4179b2129d2ef10fe9b79523b10a9c80d8dd63be8a0f6282a4ce WatchSource:0}: Error finding container a287957c9eec4179b2129d2ef10fe9b79523b10a9c80d8dd63be8a0f6282a4ce: Status 404 returned error can't find the container with id a287957c9eec4179b2129d2ef10fe9b79523b10a9c80d8dd63be8a0f6282a4ce
Jul 14 07:50:57.359223 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:57.359171    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4wjks" podStartSLOduration=1.286227316 podStartE2EDuration="7.35915382s" totalImagesPullingTime="6.072926504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:57.358773442 +0000 UTC m=+52.937779781" watchObservedRunningTime="2026-07-14 07:50:57.35915382 +0000 UTC m=+52.938160158"
Jul 14 07:50:58.065353 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:58.065320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:58.120884 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:58.120851    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:58.271647 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:58.271609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:50:58.332730 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:58.332692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697bdc78d-m8tbw" event={"ID":"4782a79e-8c10-45dc-bf89-e46d3855a7e8","Type":"ContainerStarted","Data":"a287957c9eec4179b2129d2ef10fe9b79523b10a9c80d8dd63be8a0f6282a4ce"}
Jul 14 07:50:58.334880 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:58.334852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xc8pq" event={"ID":"68265154-53df-4b2e-94da-11819b064085","Type":"ContainerStarted","Data":"7b96ab3cf4a688967b4d174f77a0156b69ee83955a6ad8830471b7194daf05f8"}
Jul 14 07:50:58.374565 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:50:58.374529    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:01.075967 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:01.075931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:01.390457 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:01.390367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:01.490960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:01.490897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:01.592551 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:01.592515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:03.049590 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:03.049557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:03.110291 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:03.110220    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:03.356229 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:03.356132    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xc8pq" event={"ID":"68265154-53df-4b2e-94da-11819b064085","Type":"ContainerStarted","Data":"c6562b2b5bc8fc8ac590992718fbc2597877fe8cef4b57696eca7ba4f7a5c8b3"}
Jul 14 07:51:03.357701 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:03.357677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697bdc78d-m8tbw" event={"ID":"4782a79e-8c10-45dc-bf89-e46d3855a7e8","Type":"ContainerStarted","Data":"734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a"}
Jul 14 07:51:03.375141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:03.375090    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xc8pq" podStartSLOduration=2.026801233 podStartE2EDuration="13.375073737s" totalImagesPullingTime="11.348272504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:03.373468661 +0000 UTC m=+58.952474997" watchObservedRunningTime="2026-07-14 07:51:03.375073737 +0000 UTC m=+58.954080076"
Jul 14 07:51:03.391249 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:03.391189    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8697bdc78d-m8tbw" podStartSLOduration=2.408592804 podStartE2EDuration="7.391170421s" totalImagesPullingTime="4.982577617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:03.391087177 +0000 UTC m=+58.970093517" watchObservedRunningTime="2026-07-14 07:51:03.391170421 +0000 UTC m=+58.970176760"
Jul 14 07:51:04.408301 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:04.408268    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:04.508849 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:04.508813    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:04.563597 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:04.563569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:05.262943 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:05.262913    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbsmz"
Jul 14 07:51:05.417071 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:05.417013    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:05.518375 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:05.518295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:07.203805 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.203758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:51:07.204245 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.203832    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:51:07.205259 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.205232    2579 patch_prober.go:28] interesting pod/console-8697bdc78d-m8tbw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body=
Jul 14 07:51:07.205392 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.205281    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8697bdc78d-m8tbw" podUID="4782a79e-8c10-45dc-bf89-e46d3855a7e8" containerName="console" probeResult="failure" output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused"
Jul 14 07:51:07.337872 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.337799    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4wjks"
Jul 14 07:51:07.562280 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.562248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:07.661074 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.660973    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:07.764216 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.764183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:07.853484 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.853454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:07.915538 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.915445    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:07.974397 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:07.974353    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:08.167972 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:08.167896    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:08.658225 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:08.658196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:08.754748 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:08.754712    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:10.619078 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.619019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:51:10.621787 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.621768    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 07:51:10.633568 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.633536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ed038c2-74e2-4ce0-bbdd-206378df7c25-metrics-certs\") pod \"network-metrics-daemon-wswkj\" (UID: \"0ed038c2-74e2-4ce0-bbdd-206378df7c25\") " pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:51:10.716631 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.716601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:10.719735 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.719713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:51:10.722560 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.722542    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 07:51:10.733085 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.733056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3848661b-bad6-4761-9823-1d213895ab2a-original-pull-secret\") pod \"global-pull-secret-syncer-hz6wd\" (UID: \"3848661b-bad6-4761-9823-1d213895ab2a\") " pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:51:10.816549 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.816515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:10.820540 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.820513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:51:10.826711 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.826686    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 07:51:10.834988 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.834966    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 07:51:10.844700 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.844672    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pnsw\" (UniqueName: \"kubernetes.io/projected/998ec576-9e5f-4dc6-bf7e-aa4e0e658436-kube-api-access-8pnsw\") pod \"network-check-target-vkrgz\" (UID: \"998ec576-9e5f-4dc6-bf7e-aa4e0e658436\") " pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:51:10.900277 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.900204    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjcpw\""
Jul 14 07:51:10.907560 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.907534    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:51:10.910709 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.910626    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skvf2\""
Jul 14 07:51:10.917931 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.917906    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wswkj"
Jul 14 07:51:10.918007 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:10.917928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hz6wd"
Jul 14 07:51:11.063115 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.063075    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vkrgz"]
Jul 14 07:51:11.066533 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:11.066504    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998ec576_9e5f_4dc6_bf7e_aa4e0e658436.slice/crio-837e2904dce6d474f2a7cf7d4afee5879d0fa0d85b10e853049196725884ac9e WatchSource:0}: Error finding container 837e2904dce6d474f2a7cf7d4afee5879d0fa0d85b10e853049196725884ac9e: Status 404 returned error can't find the container with id 837e2904dce6d474f2a7cf7d4afee5879d0fa0d85b10e853049196725884ac9e
Jul 14 07:51:11.292681 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.292640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hz6wd"]
Jul 14 07:51:11.293787 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.293732    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wswkj"]
Jul 14 07:51:11.295455 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:11.295426    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed038c2_74e2_4ce0_bbdd_206378df7c25.slice/crio-5afc7b96888afc35f649bfb64d890125eb3b633dcf61e32a535143bbcbe7be38 WatchSource:0}: Error finding container 5afc7b96888afc35f649bfb64d890125eb3b633dcf61e32a535143bbcbe7be38: Status 404 returned error can't find the container with id 5afc7b96888afc35f649bfb64d890125eb3b633dcf61e32a535143bbcbe7be38
Jul 14 07:51:11.295969 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:11.295948    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3848661b_bad6_4761_9823_1d213895ab2a.slice/crio-2c55b62825be3338758985f419cd4b105e5db6f9b0f69195ffcdbb0e56e59855 WatchSource:0}: Error finding container 2c55b62825be3338758985f419cd4b105e5db6f9b0f69195ffcdbb0e56e59855: Status 404 returned error can't find the container with id 2c55b62825be3338758985f419cd4b105e5db6f9b0f69195ffcdbb0e56e59855
Jul 14 07:51:11.383552 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.383521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vkrgz" event={"ID":"998ec576-9e5f-4dc6-bf7e-aa4e0e658436","Type":"ContainerStarted","Data":"837e2904dce6d474f2a7cf7d4afee5879d0fa0d85b10e853049196725884ac9e"}
Jul 14 07:51:11.384591 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.384565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hz6wd" event={"ID":"3848661b-bad6-4761-9823-1d213895ab2a","Type":"ContainerStarted","Data":"2c55b62825be3338758985f419cd4b105e5db6f9b0f69195ffcdbb0e56e59855"}
Jul 14 07:51:11.385620 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.385580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wswkj" event={"ID":"0ed038c2-74e2-4ce0-bbdd-206378df7c25","Type":"ContainerStarted","Data":"5afc7b96888afc35f649bfb64d890125eb3b633dcf61e32a535143bbcbe7be38"}
Jul 14 07:51:11.802477 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.802443    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:11.855370 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.855331    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ch54t"]
Jul 14 07:51:11.858171 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.858146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:11.861471 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.861441    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xvs9r\""
Jul 14 07:51:11.861706 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.861686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 14 07:51:11.862871 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.862846    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 07:51:11.863119 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.863099    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 07:51:11.863384 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.863367    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 07:51:11.863958 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.863936    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 14 07:51:11.871360 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.871329    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ch54t"]
Jul 14 07:51:11.880214 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.880000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:11.928901 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.928865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b84d36e8-d929-4b91-8a5c-df927b58a15c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:11.929120 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.928919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:11.929120 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.928985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:11.929120 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.929016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx9gg\" (UniqueName: \"kubernetes.io/projected/b84d36e8-d929-4b91-8a5c-df927b58a15c-kube-api-access-bx9gg\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:11.946447 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:11.946351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:12.029875 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.029836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b84d36e8-d929-4b91-8a5c-df927b58a15c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.030086 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.029889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.030086 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.029945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.030086 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.029994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx9gg\" (UniqueName: \"kubernetes.io/projected/b84d36e8-d929-4b91-8a5c-df927b58a15c-kube-api-access-bx9gg\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.030247 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:51:12.030103    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 14 07:51:12.030247 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:51:12.030180    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-tls podName:b84d36e8-d929-4b91-8a5c-df927b58a15c nodeName:}" failed. No retries permitted until 2026-07-14 07:51:12.530159133 +0000 UTC m=+68.109165456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-tls") pod "prometheus-operator-64785b6675-ch54t" (UID: "b84d36e8-d929-4b91-8a5c-df927b58a15c") : secret "prometheus-operator-tls" not found
Jul 14 07:51:12.030748 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.030721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b84d36e8-d929-4b91-8a5c-df927b58a15c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.033227 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.033167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.040651 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.040623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx9gg\" (UniqueName: \"kubernetes.io/projected/b84d36e8-d929-4b91-8a5c-df927b58a15c-kube-api-access-bx9gg\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.139112 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.138967    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:12.400945 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.400856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wswkj" event={"ID":"0ed038c2-74e2-4ce0-bbdd-206378df7c25","Type":"ContainerStarted","Data":"658be9e9f0469b915687fa0b5e8cdf3ba9e4d602dc793431d9f123eab412bc36"}
Jul 14 07:51:12.534441 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.534390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.537427 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.537373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b84d36e8-d929-4b91-8a5c-df927b58a15c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ch54t\" (UID: \"b84d36e8-d929-4b91-8a5c-df927b58a15c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.775431 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.775396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t"
Jul 14 07:51:12.927346 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:12.927305    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ch54t"]
Jul 14 07:51:12.931534 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:12.931494    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84d36e8_d929_4b91_8a5c_df927b58a15c.slice/crio-7784094a359945e157331c08b61e3c06a59cec1e517a1a61e34108778b2665c3 WatchSource:0}: Error finding container 7784094a359945e157331c08b61e3c06a59cec1e517a1a61e34108778b2665c3: Status 404 returned error can't find the container with id 7784094a359945e157331c08b61e3c06a59cec1e517a1a61e34108778b2665c3
Jul 14 07:51:13.407193 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:13.407153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wswkj" event={"ID":"0ed038c2-74e2-4ce0-bbdd-206378df7c25","Type":"ContainerStarted","Data":"aa3a9353882cbc1f19df049acccd31a028da1984d28c57da04979d0f604a56db"}
Jul 14 07:51:13.408732 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:13.408700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t" event={"ID":"b84d36e8-d929-4b91-8a5c-df927b58a15c","Type":"ContainerStarted","Data":"7784094a359945e157331c08b61e3c06a59cec1e517a1a61e34108778b2665c3"}
Jul 14 07:51:13.423216 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:13.423152    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wswkj" podStartSLOduration=67.457042567 podStartE2EDuration="1m8.423127036s" totalImagesPullingTime="966.084469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:13.42249969 +0000 UTC m=+69.001506030" watchObservedRunningTime="2026-07-14 07:51:13.423127036 +0000 UTC m=+69.002133377"
Jul 14 07:51:13.500893 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:13.500857    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:13.558620 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:13.558591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:13.636009 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:13.635907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:13.965601 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:13.965552    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:14.021548 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:14.021510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:14.414381 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:14.414343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vkrgz" event={"ID":"998ec576-9e5f-4dc6-bf7e-aa4e0e658436","Type":"ContainerStarted","Data":"52d26b7415f566b37ca8308c37490040ece71c4883610743889c6d9b3a3ecb94"}
Jul 14 07:51:14.433088 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:14.433011    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vkrgz" podStartSLOduration=66.335428033 podStartE2EDuration="1m9.432986864s" totalImagesPullingTime="3.097558831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:14.431402103 +0000 UTC m=+70.010408512" watchObservedRunningTime="2026-07-14 07:51:14.432986864 +0000 UTC m=+70.011993205"
Jul 14 07:51:15.417578 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:15.417542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:51:15.990195 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:15.990156    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:16.047911 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:16.047879    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:16.425113 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:16.425077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t" event={"ID":"b84d36e8-d929-4b91-8a5c-df927b58a15c","Type":"ContainerStarted","Data":"643313179ecb806a036a3f928c3de90119da27d23cba7b62d60ce425e103e821"}
Jul 14 07:51:16.426820 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:16.426769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hz6wd" event={"ID":"3848661b-bad6-4761-9823-1d213895ab2a","Type":"ContainerStarted","Data":"22a09fbb7c6b30f08cf57134b55469e44bc1ee6f8ad5713922c2ff2932d99d00"}
Jul 14 07:51:16.442343 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:16.442282    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hz6wd" podStartSLOduration=66.408562937 podStartE2EDuration="1m11.442261241s" totalImagesPullingTime="5.033698304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:16.441818993 +0000 UTC m=+72.020825332" watchObservedRunningTime="2026-07-14 07:51:16.442261241 +0000 UTC m=+72.021267581"
Jul 14 07:51:16.470076 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:16.470030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:16.586456 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:16.586360    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:16.673150 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:16.673116    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:17.207719 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:17.207688    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:51:17.211500 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:17.211477    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:51:17.374899 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:17.374864    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:17.432165 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:17.432123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t" event={"ID":"b84d36e8-d929-4b91-8a5c-df927b58a15c","Type":"ContainerStarted","Data":"4049db6965ca9aba47791048968551bef5c65e65f3d4f5a40b3b438bd5e1ad0f"}
Jul 14 07:51:17.451340 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:17.451291    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-ch54t" podStartSLOduration=3.064578939 podStartE2EDuration="6.451275759s" totalImagesPullingTime="3.38669682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:17.450608075 +0000 UTC m=+73.029614416" watchObservedRunningTime="2026-07-14 07:51:17.451275759 +0000 UTC m=+73.030282097"
Jul 14 07:51:17.455561 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:17.455537    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:17.509536 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:17.509504    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:18.121669 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:18.121635    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:18.173751 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:18.173719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:18.973167 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:18.973133    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:19.163131 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.163097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:19.198855 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.198823    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-prhv4"]
Jul 14 07:51:19.200809 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.200794    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.203569 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.203528    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 14 07:51:19.204722 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.204700    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vdrgl\""
Jul 14 07:51:19.204859 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.204734    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 14 07:51:19.204859 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.204756    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 14 07:51:19.214565 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.214534    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-prhv4"]
Jul 14 07:51:19.220527 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.220505    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mgg9b"]
Jul 14 07:51:19.222500 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.222485    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.225274 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.225209    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 07:51:19.225274 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.225255    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cdj8g\""
Jul 14 07:51:19.225439 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.225364    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 07:51:19.225577 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.225564    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 07:51:19.253975 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.253939    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:19.285184 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-wtmp\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.285184 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq5dx\" (UniqueName: \"kubernetes.io/projected/ac073049-a55c-4471-82b8-c6c689a15a5b-kube-api-access-pq5dx\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.285400 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84vkd\" (UniqueName: \"kubernetes.io/projected/0d77122c-0812-4916-aea6-a2c325af973b-kube-api-access-84vkd\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.285400 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac073049-a55c-4471-82b8-c6c689a15a5b-metrics-client-ca\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.285400 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-root\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.285400 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-textfile\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.285400 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.285400 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d77122c-0812-4916-aea6-a2c325af973b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.285400 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d77122c-0812-4916-aea6-a2c325af973b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.285614 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.285614 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.285614 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.285614 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-tls\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.285614 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.285614 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.285545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-sys\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.334302 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.334267    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:19.386593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-root\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.386593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-textfile\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.386821 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.386821 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-root\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.386821 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d77122c-0812-4916-aea6-a2c325af973b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.386821 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d77122c-0812-4916-aea6-a2c325af973b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.386821 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:51:19.386735    2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 14 07:51:19.386821 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:51:19.386864    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-tls podName:0d77122c-0812-4916-aea6-a2c325af973b nodeName:}" failed. No retries permitted until 2026-07-14 07:51:19.886839549 +0000 UTC m=+75.465845880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-prhv4" (UID: "0d77122c-0812-4916-aea6-a2c325af973b") : secret "kube-state-metrics-tls" not found
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-tls\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-textfile\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.386995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-sys\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-wtmp\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq5dx\" (UniqueName: \"kubernetes.io/projected/ac073049-a55c-4471-82b8-c6c689a15a5b-kube-api-access-pq5dx\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84vkd\" (UniqueName: \"kubernetes.io/projected/0d77122c-0812-4916-aea6-a2c325af973b-kube-api-access-84vkd\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.387155 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:51:19.387140    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 14 07:51:19.387680 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac073049-a55c-4471-82b8-c6c689a15a5b-metrics-client-ca\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387680 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:51:19.387205    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-tls podName:ac073049-a55c-4471-82b8-c6c689a15a5b nodeName:}" failed. No retries permitted until 2026-07-14 07:51:19.887188453 +0000 UTC m=+75.466194775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-tls") pod "node-exporter-mgg9b" (UID: "ac073049-a55c-4471-82b8-c6c689a15a5b") : secret "node-exporter-tls" not found
Jul 14 07:51:19.387680 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d77122c-0812-4916-aea6-a2c325af973b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.387680 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-sys\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387680 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-wtmp\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387680 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.387680 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d77122c-0812-4916-aea6-a2c325af973b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.387927 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.387824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac073049-a55c-4471-82b8-c6c689a15a5b-metrics-client-ca\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.388029 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.388012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.389468 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.389447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.389561 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.389495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.398906 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.398873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84vkd\" (UniqueName: \"kubernetes.io/projected/0d77122c-0812-4916-aea6-a2c325af973b-kube-api-access-84vkd\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.399055 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.399015    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq5dx\" (UniqueName: \"kubernetes.io/projected/ac073049-a55c-4471-82b8-c6c689a15a5b-kube-api-access-pq5dx\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.450374 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.450337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:19.579353 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.579266    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:19.680313 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.680281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:19.781436 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.781401    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:19.892376 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.892278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:19.892376 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.892336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-tls\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.894652 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.894623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac073049-a55c-4471-82b8-c6c689a15a5b-node-exporter-tls\") pod \"node-exporter-mgg9b\" (UID: \"ac073049-a55c-4471-82b8-c6c689a15a5b\") " pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:19.894768 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:19.894723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d77122c-0812-4916-aea6-a2c325af973b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-prhv4\" (UID: \"0d77122c-0812-4916-aea6-a2c325af973b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:20.109964 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:20.109911    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4"
Jul 14 07:51:20.131416 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:20.131384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mgg9b"
Jul 14 07:51:20.143819 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:20.143752    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac073049_a55c_4471_82b8_c6c689a15a5b.slice/crio-2ac622103af126c369d6ac5c600e4943c2ec4fc1fee2561da4e781709a332d84 WatchSource:0}: Error finding container 2ac622103af126c369d6ac5c600e4943c2ec4fc1fee2561da4e781709a332d84: Status 404 returned error can't find the container with id 2ac622103af126c369d6ac5c600e4943c2ec4fc1fee2561da4e781709a332d84
Jul 14 07:51:20.187864 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:20.187837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:20.246298 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:20.246264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-prhv4"]
Jul 14 07:51:20.249735 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:20.249709    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d77122c_0812_4916_aea6_a2c325af973b.slice/crio-b209c852112ee000e491cd96d35fe5ae0573944eea9ae0406c80701caf133e63 WatchSource:0}: Error finding container b209c852112ee000e491cd96d35fe5ae0573944eea9ae0406c80701caf133e63: Status 404 returned error can't find the container with id b209c852112ee000e491cd96d35fe5ae0573944eea9ae0406c80701caf133e63
Jul 14 07:51:20.311275 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:20.311228    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:20.404440 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:20.404357    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:20.443566 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:20.443524    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mgg9b" event={"ID":"ac073049-a55c-4471-82b8-c6c689a15a5b","Type":"ContainerStarted","Data":"2ac622103af126c369d6ac5c600e4943c2ec4fc1fee2561da4e781709a332d84"}
Jul 14 07:51:20.444691 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:20.444667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4" event={"ID":"0d77122c-0812-4916-aea6-a2c325af973b","Type":"ContainerStarted","Data":"b209c852112ee000e491cd96d35fe5ae0573944eea9ae0406c80701caf133e63"}
Jul 14 07:51:22.156695 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.156662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:22.257699 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.257661    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:22.357827 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.357786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:22.452544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.452448    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac073049-a55c-4471-82b8-c6c689a15a5b" containerID="46ea9164a5488a769ed3602c80959455f9920a7f1cc2520e104d4f9b34e59663" exitCode=0
Jul 14 07:51:22.452544 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.452536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mgg9b" event={"ID":"ac073049-a55c-4471-82b8-c6c689a15a5b","Type":"ContainerDied","Data":"46ea9164a5488a769ed3602c80959455f9920a7f1cc2520e104d4f9b34e59663"}
Jul 14 07:51:22.455078 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.455052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4" event={"ID":"0d77122c-0812-4916-aea6-a2c325af973b","Type":"ContainerStarted","Data":"40691cc15464758359367596d4eaf67b41cab476538d833463a2ccce0283aa59"}
Jul 14 07:51:22.455213 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.455113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4" event={"ID":"0d77122c-0812-4916-aea6-a2c325af973b","Type":"ContainerStarted","Data":"c1b1124b8d149a24ddb9bbdf4fc73f121444a424eadec1c974dc37025dae2f0f"}
Jul 14 07:51:22.455213 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.455144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4" event={"ID":"0d77122c-0812-4916-aea6-a2c325af973b","Type":"ContainerStarted","Data":"b224b0c1b309e2ceb3bd70c86e509accdc1151bb19d0585c0ba4371d77217614"}
Jul 14 07:51:22.456996 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.456945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:22.488272 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:22.488214    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-prhv4" podStartSLOduration=2.284424755 podStartE2EDuration="3.488197432s" totalImagesPullingTime="1.203772677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:22.487949854 +0000 UTC m=+78.066956193" watchObservedRunningTime="2026-07-14 07:51:22.488197432 +0000 UTC m=+78.067203770"
Jul 14 07:51:23.460584 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.460546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mgg9b" event={"ID":"ac073049-a55c-4471-82b8-c6c689a15a5b","Type":"ContainerStarted","Data":"175562690e832e554c58b787772aa50c15c624dd29bd2890d0f357d4ab66141e"}
Jul 14 07:51:23.461094 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.460609    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mgg9b" event={"ID":"ac073049-a55c-4471-82b8-c6c689a15a5b","Type":"ContainerStarted","Data":"1f886aed47115fb2fb146d03f602b6c53e7f440139a19dc8b300d8e92ee686b8"}
Jul 14 07:51:23.482851 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.482792    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mgg9b" podStartSLOduration=3.096385673 podStartE2EDuration="4.482775878s" totalImagesPullingTime="1.307318748s" totalInitContainerRuntime="79.071457ms" isStatefulPod=true podCreationTimestamp="2026-07-14 07:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:23.482310902 +0000 UTC m=+79.061317254" watchObservedRunningTime="2026-07-14 07:51:23.482775878 +0000 UTC m=+79.061782217"
Jul 14 07:51:23.490416 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.490383    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6575f78bff-nwvp2"]
Jul 14 07:51:23.492615 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.492574    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.495191 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.495158    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 14 07:51:23.495346 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.495325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xrn2k\""
Jul 14 07:51:23.495521 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.495498    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 07:51:23.495521 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.495509    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6qffagkc75ops\""
Jul 14 07:51:23.495521 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.495511    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 14 07:51:23.495700 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.495632    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 14 07:51:23.501752 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.501729    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6575f78bff-nwvp2"]
Jul 14 07:51:23.623821 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.623778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/af542d5e-1557-491d-96de-f739dccf2a75-metrics-server-audit-profiles\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.623996 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.623830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvg9h\" (UniqueName: \"kubernetes.io/projected/af542d5e-1557-491d-96de-f739dccf2a75-kube-api-access-jvg9h\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.623996 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.623945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-secret-metrics-server-tls\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.623996 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.623986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-secret-metrics-server-client-certs\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.624218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.624015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-client-ca-bundle\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.624218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.624109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/af542d5e-1557-491d-96de-f739dccf2a75-audit-log\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.624218 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.624141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af542d5e-1557-491d-96de-f739dccf2a75-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.724743 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.724704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/af542d5e-1557-491d-96de-f739dccf2a75-metrics-server-audit-profiles\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.724743 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.724749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvg9h\" (UniqueName: \"kubernetes.io/projected/af542d5e-1557-491d-96de-f739dccf2a75-kube-api-access-jvg9h\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.724985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.724776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-secret-metrics-server-tls\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.725060 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.724983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-secret-metrics-server-client-certs\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.725060 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.725024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-client-ca-bundle\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.725156 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.725105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/af542d5e-1557-491d-96de-f739dccf2a75-audit-log\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.725156 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.725136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af542d5e-1557-491d-96de-f739dccf2a75-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.725479 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.725451    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/af542d5e-1557-491d-96de-f739dccf2a75-audit-log\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.725829 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.725806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af542d5e-1557-491d-96de-f739dccf2a75-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.725943 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.725925    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/af542d5e-1557-491d-96de-f739dccf2a75-metrics-server-audit-profiles\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.727247 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.727224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-client-ca-bundle\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.727434 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.727413    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-secret-metrics-server-tls\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.727484 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.727446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/af542d5e-1557-491d-96de-f739dccf2a75-secret-metrics-server-client-certs\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.733725 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.733702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvg9h\" (UniqueName: \"kubernetes.io/projected/af542d5e-1557-491d-96de-f739dccf2a75-kube-api-access-jvg9h\") pod \"metrics-server-6575f78bff-nwvp2\" (UID: \"af542d5e-1557-491d-96de-f739dccf2a75\") " pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.802231 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.802190    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:23.932385 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.932353    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6575f78bff-nwvp2"]
Jul 14 07:51:23.936427 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:23.936321    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf542d5e_1557_491d_96de_f739dccf2a75.slice/crio-07b765552e2086eec7f6ef4bd0c2059283d7db7fe6de32cd3244bf28fb985592 WatchSource:0}: Error finding container 07b765552e2086eec7f6ef4bd0c2059283d7db7fe6de32cd3244bf28fb985592: Status 404 returned error can't find the container with id 07b765552e2086eec7f6ef4bd0c2059283d7db7fe6de32cd3244bf28fb985592
Jul 14 07:51:23.984336 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.984257    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:23.993660 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.993631    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74677fbff8-qp8sl"]
Jul 14 07:51:23.996527 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.996503    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"]
Jul 14 07:51:23.996642 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.996624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:23.998516 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:23.998499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:24.000959 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.000939    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 07:51:24.001089 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.000945    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-x98gz\""
Jul 14 07:51:24.008582 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.008560    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"]
Jul 14 07:51:24.009661 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.009638    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74677fbff8-qp8sl"]
Jul 14 07:51:24.047163 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.047127    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:24.128506 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-serving-cert\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.128506 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-service-ca\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.128779 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-oauth-serving-cert\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.128779 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-trusted-ca-bundle\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.128779 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v72dq\" (UniqueName: \"kubernetes.io/projected/8c0f0e87-b450-42b1-b391-c8a019454092-kube-api-access-v72dq\") pod \"monitoring-plugin-5f68df7f58-8vmpb\" (UID: \"8c0f0e87-b450-42b1-b391-c8a019454092\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:24.128779 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qsqk\" (UniqueName: \"kubernetes.io/projected/eef967a8-3dc1-4b94-a96c-9928030724ac-kube-api-access-8qsqk\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.128779 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-oauth-config\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.128779 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-console-config\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.128996 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.128791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c0f0e87-b450-42b1-b391-c8a019454092-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8vmpb\" (UID: \"8c0f0e87-b450-42b1-b391-c8a019454092\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:24.171831 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.171802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:24.230000 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.229962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-serving-cert\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.230000 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-service-ca\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.230295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-oauth-serving-cert\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.230295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-trusted-ca-bundle\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.230295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v72dq\" (UniqueName: \"kubernetes.io/projected/8c0f0e87-b450-42b1-b391-c8a019454092-kube-api-access-v72dq\") pod \"monitoring-plugin-5f68df7f58-8vmpb\" (UID: \"8c0f0e87-b450-42b1-b391-c8a019454092\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:24.230295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qsqk\" (UniqueName: \"kubernetes.io/projected/eef967a8-3dc1-4b94-a96c-9928030724ac-kube-api-access-8qsqk\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.230295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-oauth-config\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.230295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-console-config\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.230295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c0f0e87-b450-42b1-b391-c8a019454092-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8vmpb\" (UID: \"8c0f0e87-b450-42b1-b391-c8a019454092\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:24.230926 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.230890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-service-ca\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.231131 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.231110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-console-config\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.231371 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.231353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-oauth-serving-cert\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.231435 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.231378    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-trusted-ca-bundle\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.232663 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.232643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-serving-cert\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.232742 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.232692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8c0f0e87-b450-42b1-b391-c8a019454092-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8vmpb\" (UID: \"8c0f0e87-b450-42b1-b391-c8a019454092\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:24.232742 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.232701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-oauth-config\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.239569 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.239515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v72dq\" (UniqueName: \"kubernetes.io/projected/8c0f0e87-b450-42b1-b391-c8a019454092-kube-api-access-v72dq\") pod \"monitoring-plugin-5f68df7f58-8vmpb\" (UID: \"8c0f0e87-b450-42b1-b391-c8a019454092\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:24.239639 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.239608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qsqk\" (UniqueName: \"kubernetes.io/projected/eef967a8-3dc1-4b94-a96c-9928030724ac-kube-api-access-8qsqk\") pod \"console-74677fbff8-qp8sl\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") " pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.276295 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.276269    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:24.309309 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.309273    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:24.315067 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.315048    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:24.468650 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.468615    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2" event={"ID":"af542d5e-1557-491d-96de-f739dccf2a75","Type":"ContainerStarted","Data":"07b765552e2086eec7f6ef4bd0c2059283d7db7fe6de32cd3244bf28fb985592"}
Jul 14 07:51:24.478606 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:24.478394    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef967a8_3dc1_4b94_a96c_9928030724ac.slice/crio-0556b06e9dff161b34ff6dd5a7d06676051d047e731117cd31c6b6a24df889d0 WatchSource:0}: Error finding container 0556b06e9dff161b34ff6dd5a7d06676051d047e731117cd31c6b6a24df889d0: Status 404 returned error can't find the container with id 0556b06e9dff161b34ff6dd5a7d06676051d047e731117cd31c6b6a24df889d0
Jul 14 07:51:24.478757 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.478734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74677fbff8-qp8sl"]
Jul 14 07:51:24.490792 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:24.490740    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"]
Jul 14 07:51:24.493435 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:24.493410    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0f0e87_b450_42b1_b391_c8a019454092.slice/crio-e4d400820293bd6592e4c84c6785d60c16e25aac68a7fae2c9c94fa9f259e7c8 WatchSource:0}: Error finding container e4d400820293bd6592e4c84c6785d60c16e25aac68a7fae2c9c94fa9f259e7c8: Status 404 returned error can't find the container with id e4d400820293bd6592e4c84c6785d60c16e25aac68a7fae2c9c94fa9f259e7c8
Jul 14 07:51:25.466738 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.466605    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 07:51:25.470466 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.470443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.473176 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.473147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:25.473944 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.473917    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 07:51:25.475455 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.475432    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 07:51:25.475564 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.475475    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 07:51:25.475621 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.475597    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 07:51:25.475802 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.475784    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 07:51:25.475856 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.475784    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 07:51:25.476251 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.476228    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 07:51:25.476357 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.476338    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 07:51:25.476738 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.476431    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 07:51:25.476738 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.476563    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 07:51:25.476738 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.476563    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 07:51:25.477179 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.476941    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qx96b\""
Jul 14 07:51:25.477179 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.476990    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 07:51:25.477346 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.477311    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8v6skaefqemkt\""
Jul 14 07:51:25.480212 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.478879    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 07:51:25.481010 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.480929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb" event={"ID":"8c0f0e87-b450-42b1-b391-c8a019454092","Type":"ContainerStarted","Data":"e4d400820293bd6592e4c84c6785d60c16e25aac68a7fae2c9c94fa9f259e7c8"}
Jul 14 07:51:25.482749 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.482731    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 07:51:25.483673 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.483649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74677fbff8-qp8sl" event={"ID":"eef967a8-3dc1-4b94-a96c-9928030724ac","Type":"ContainerStarted","Data":"368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722"}
Jul 14 07:51:25.483836 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.483819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74677fbff8-qp8sl" event={"ID":"eef967a8-3dc1-4b94-a96c-9928030724ac","Type":"ContainerStarted","Data":"0556b06e9dff161b34ff6dd5a7d06676051d047e731117cd31c6b6a24df889d0"}
Jul 14 07:51:25.492382 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.492353    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 07:51:25.542718 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.542677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01674c41-8880-4831-837e-3cdf59696a06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.542985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.542959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543132 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543132 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-web-config\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543250 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543250 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543250 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543403 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543403 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543403 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543548 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543548 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01674c41-8880-4831-837e-3cdf59696a06-config-out\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543548 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543548 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-config\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543548 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrlx\" (UniqueName: \"kubernetes.io/projected/01674c41-8880-4831-837e-3cdf59696a06-kube-api-access-zrrlx\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.543786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.543664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.547811 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.547758    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74677fbff8-qp8sl" podStartSLOduration=2.547739623 podStartE2EDuration="2.547739623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:25.547483999 +0000 UTC m=+81.126490338" watchObservedRunningTime="2026-07-14 07:51:25.547739623 +0000 UTC m=+81.126745963"
Jul 14 07:51:25.645091 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-web-config\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645277 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645277 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645277 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645277 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645277 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01674c41-8880-4831-837e-3cdf59696a06-config-out\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-config\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrlx\" (UniqueName: \"kubernetes.io/projected/01674c41-8880-4831-837e-3cdf59696a06-kube-api-access-zrrlx\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645844 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.645844 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.645833    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.646202 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.646168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.646610 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.646502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.649423 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.649401    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-config\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.649841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.649842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-web-config\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.650115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.650168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.650225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.650252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.650286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01674c41-8880-4831-837e-3cdf59696a06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.650327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.650379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.651060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.651082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.650284    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.652458 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.652086    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01674c41-8880-4831-837e-3cdf59696a06-config-out\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.652458 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.652244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.652458 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.652375    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.654855 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.654789    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01674c41-8880-4831-837e-3cdf59696a06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.655159 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.655026    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.655256 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.655234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.656230 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.656176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.656793 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.656764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.656927 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.656904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01674c41-8880-4831-837e-3cdf59696a06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.657242 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.657215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01674c41-8880-4831-837e-3cdf59696a06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.658726 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.658701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrlx\" (UniqueName: \"kubernetes.io/projected/01674c41-8880-4831-837e-3cdf59696a06-kube-api-access-zrrlx\") pod \"prometheus-k8s-0\" (UID: \"01674c41-8880-4831-837e-3cdf59696a06\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:25.788209 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:25.788107    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:26.117224 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:26.117198    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 07:51:26.119754 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:26.119722    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01674c41_8880_4831_837e_3cdf59696a06.slice/crio-ef936f8e3779f326e975b4773c3eb6b6d7c591ffa63c0c0b2055d0a6d73d97a6 WatchSource:0}: Error finding container ef936f8e3779f326e975b4773c3eb6b6d7c591ffa63c0c0b2055d0a6d73d97a6: Status 404 returned error can't find the container with id ef936f8e3779f326e975b4773c3eb6b6d7c591ffa63c0c0b2055d0a6d73d97a6
Jul 14 07:51:26.488844 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:26.488805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2" event={"ID":"af542d5e-1557-491d-96de-f739dccf2a75","Type":"ContainerStarted","Data":"bcaa7746840931bc3a4f07d11974193ac225e228bf8d44753332819efe6924e5"}
Jul 14 07:51:26.490315 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:26.490296    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb" event={"ID":"8c0f0e87-b450-42b1-b391-c8a019454092","Type":"ContainerStarted","Data":"df93fbe74afbe421d507e286ac7622a54ea192ef1fbfdd4b4789af71f14c52af"}
Jul 14 07:51:26.490473 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:26.490456    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:26.491565 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:26.491540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01674c41-8880-4831-837e-3cdf59696a06","Type":"ContainerStarted","Data":"ef936f8e3779f326e975b4773c3eb6b6d7c591ffa63c0c0b2055d0a6d73d97a6"}
Jul 14 07:51:26.495551 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:26.495534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb"
Jul 14 07:51:26.505850 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:26.505732    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2" podStartSLOduration=1.8999625089999999 podStartE2EDuration="3.505712835s" totalImagesPullingTime="1.605750326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:26.505223118 +0000 UTC m=+82.084229461" watchObservedRunningTime="2026-07-14 07:51:26.505712835 +0000 UTC m=+82.084719175"
Jul 14 07:51:26.520107 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:26.520031    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8vmpb" podStartSLOduration=2.017813466 podStartE2EDuration="3.52001552s" totalImagesPullingTime="1.502202054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:26.518856079 +0000 UTC m=+82.097862410" watchObservedRunningTime="2026-07-14 07:51:26.52001552 +0000 UTC m=+82.099021882"
Jul 14 07:51:27.497121 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:27.497093    2579 generic.go:356] "Generic (PLEG): container finished" podID="01674c41-8880-4831-837e-3cdf59696a06" containerID="f02cb20357c26518149f0ecc8a281187797200b7966bdd175e65e96a3cf81302" exitCode=0
Jul 14 07:51:27.497579 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:27.497181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01674c41-8880-4831-837e-3cdf59696a06","Type":"ContainerDied","Data":"f02cb20357c26518149f0ecc8a281187797200b7966bdd175e65e96a3cf81302"}
Jul 14 07:51:28.746361 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.746322    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74677fbff8-qp8sl"]
Jul 14 07:51:28.775706 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.775674    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f696556bc-t7n54"]
Jul 14 07:51:28.786750 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.786718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.789583 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.789550    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f696556bc-t7n54"]
Jul 14 07:51:28.881264 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.881223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-oauth-config\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.881464 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.881283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpzp8\" (UniqueName: \"kubernetes.io/projected/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-kube-api-access-rpzp8\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.881464 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.881366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-trusted-ca-bundle\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.881464 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.881455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-oauth-serving-cert\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.881638 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.881486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-service-ca\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.881638 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.881550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-serving-cert\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.881638 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.881589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-config\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.959102 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.959069    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:28.982618 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.982575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-oauth-serving-cert\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.982618 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.982620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-service-ca\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.982880 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.982675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-serving-cert\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.982880 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.982695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-config\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.982880 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.982741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-oauth-config\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.982880 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.982777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpzp8\" (UniqueName: \"kubernetes.io/projected/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-kube-api-access-rpzp8\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.984181 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.982930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-trusted-ca-bundle\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.984181 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.983810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-config\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.984181 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.983915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-service-ca\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.984181 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.983923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-oauth-serving-cert\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.984181 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.983948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-trusted-ca-bundle\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.986098 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.986053    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-oauth-config\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.989803 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.989776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-serving-cert\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:28.991813 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:28.991579    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpzp8\" (UniqueName: \"kubernetes.io/projected/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-kube-api-access-rpzp8\") pod \"console-6f696556bc-t7n54\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") " pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:29.015116 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:29.015004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:29.100115 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:29.100077    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:29.269909 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:29.269826    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f696556bc-t7n54"]
Jul 14 07:51:29.273427 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:51:29.273394    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331c2d5f_23e1_4ca7_9180_66ec38bc6fb8.slice/crio-41d1ea6da4c7a525425af1c864255b21583119a0ac49397ee5963ba2396c1636 WatchSource:0}: Error finding container 41d1ea6da4c7a525425af1c864255b21583119a0ac49397ee5963ba2396c1636: Status 404 returned error can't find the container with id 41d1ea6da4c7a525425af1c864255b21583119a0ac49397ee5963ba2396c1636
Jul 14 07:51:29.508331 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:29.508290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f696556bc-t7n54" event={"ID":"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8","Type":"ContainerStarted","Data":"63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85"}
Jul 14 07:51:29.508511 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:29.508353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f696556bc-t7n54" event={"ID":"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8","Type":"ContainerStarted","Data":"41d1ea6da4c7a525425af1c864255b21583119a0ac49397ee5963ba2396c1636"}
Jul 14 07:51:29.525458 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:29.525351    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f696556bc-t7n54" podStartSLOduration=1.525330969 podStartE2EDuration="1.525330969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:29.524811738 +0000 UTC m=+85.103818078" watchObservedRunningTime="2026-07-14 07:51:29.525330969 +0000 UTC m=+85.104337309"
Jul 14 07:51:29.531411 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:29.531379    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:29.586263 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:29.586227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:31.483213 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:31.483144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:31.584217 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:31.584184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:32.526888 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:32.526852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01674c41-8880-4831-837e-3cdf59696a06","Type":"ContainerStarted","Data":"d8eace1020d0739b20da77fd8d1f50933ebd37b998f06c77961eb6f083fd251f"}
Jul 14 07:51:32.527442 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:32.526940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01674c41-8880-4831-837e-3cdf59696a06","Type":"ContainerStarted","Data":"e2dbadb7c36463ad7158601f20cd391a44bc48989d8a7eeaf79e29325934301d"}
Jul 14 07:51:34.309383 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:34.309362    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:34.538289 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:34.538251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01674c41-8880-4831-837e-3cdf59696a06","Type":"ContainerStarted","Data":"ce765463b70726651f54b5468b397f796810f3836ff5cc9e212efc44ea1d1a82"}
Jul 14 07:51:34.538462 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:34.538335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01674c41-8880-4831-837e-3cdf59696a06","Type":"ContainerStarted","Data":"fd358241cfb5521c8b63605edeaf8eb44029c88eea63326f0ba04db4cffc1c10"}
Jul 14 07:51:34.538462 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:34.538376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01674c41-8880-4831-837e-3cdf59696a06","Type":"ContainerStarted","Data":"f8492776053fb8c5a8ac3fea59aa90b5bcc13130b3c1203e1fd55035d5e3b9ef"}
Jul 14 07:51:34.538462 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:34.538413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01674c41-8880-4831-837e-3cdf59696a06","Type":"ContainerStarted","Data":"62287802abba30fbdfa07087e1f596a39f5283b19e18c54092fca4f8a62b9860"}
Jul 14 07:51:34.571696 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:34.571629    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.108685102 podStartE2EDuration="9.571606619s" totalImagesPullingTime="7.42081292s" totalInitContainerRuntime="42.108597ms" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:34.569449644 +0000 UTC m=+90.148455984" watchObservedRunningTime="2026-07-14 07:51:34.571606619 +0000 UTC m=+90.150612959"
Jul 14 07:51:35.788977 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:35.788929    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:51:39.101301 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:39.101251    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:39.101710 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:39.101342    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:39.105880 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:39.105855    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:39.563149 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:39.563120    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:51:39.610651 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:39.610620    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8697bdc78d-m8tbw"]
Jul 14 07:51:39.714219 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:39.714186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:39.775095 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:39.775059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:39.837256 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:39.837179    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:40.546899 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:40.546866    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:43.802809 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:43.802760    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:43.803239 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:43.802842    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:51:46.429966 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:46.429928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vkrgz"
Jul 14 07:51:46.495139 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:46.495104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:46.552875 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:46.552845    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:49.688762 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:49.688728    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4lcn5_d55506b5-72dd-4f10-95bc-2abba901d2fa/serve-healthcheck-canary/0.log"
Jul 14 07:51:52.913792 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:52.913746    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:53.014824 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:53.014790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:53.116350 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:53.116315    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:51:53.773116 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:53.773079    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74677fbff8-qp8sl" podUID="eef967a8-3dc1-4b94-a96c-9928030724ac" containerName="console" containerID="cri-o://368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722" gracePeriod=15
Jul 14 07:51:54.040094 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.040016    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:54.096298 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096244    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-serving-cert\") pod \"eef967a8-3dc1-4b94-a96c-9928030724ac\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") "
Jul 14 07:51:54.096298 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096309    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-trusted-ca-bundle\") pod \"eef967a8-3dc1-4b94-a96c-9928030724ac\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") "
Jul 14 07:51:54.096562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096343    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-oauth-config\") pod \"eef967a8-3dc1-4b94-a96c-9928030724ac\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") "
Jul 14 07:51:54.096562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096383    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-service-ca\") pod \"eef967a8-3dc1-4b94-a96c-9928030724ac\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") "
Jul 14 07:51:54.096562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qsqk\" (UniqueName: \"kubernetes.io/projected/eef967a8-3dc1-4b94-a96c-9928030724ac-kube-api-access-8qsqk\") pod \"eef967a8-3dc1-4b94-a96c-9928030724ac\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") "
Jul 14 07:51:54.096562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096463    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-oauth-serving-cert\") pod \"eef967a8-3dc1-4b94-a96c-9928030724ac\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") "
Jul 14 07:51:54.096562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096533    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-console-config\") pod \"eef967a8-3dc1-4b94-a96c-9928030724ac\" (UID: \"eef967a8-3dc1-4b94-a96c-9928030724ac\") "
Jul 14 07:51:54.096901 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096780    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-service-ca" (OuterVolumeSpecName: "service-ca") pod "eef967a8-3dc1-4b94-a96c-9928030724ac" (UID: "eef967a8-3dc1-4b94-a96c-9928030724ac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:54.096901 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eef967a8-3dc1-4b94-a96c-9928030724ac" (UID: "eef967a8-3dc1-4b94-a96c-9928030724ac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:54.097126 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.096955    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-console-config" (OuterVolumeSpecName: "console-config") pod "eef967a8-3dc1-4b94-a96c-9928030724ac" (UID: "eef967a8-3dc1-4b94-a96c-9928030724ac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:54.097126 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.097028    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-trusted-ca-bundle\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:51:54.097126 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.097072    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:51:54.097535 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.097506    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eef967a8-3dc1-4b94-a96c-9928030724ac" (UID: "eef967a8-3dc1-4b94-a96c-9928030724ac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:51:54.098870 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.098850    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eef967a8-3dc1-4b94-a96c-9928030724ac" (UID: "eef967a8-3dc1-4b94-a96c-9928030724ac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:51:54.098963 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.098952    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eef967a8-3dc1-4b94-a96c-9928030724ac" (UID: "eef967a8-3dc1-4b94-a96c-9928030724ac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:51:54.099013 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.098986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef967a8-3dc1-4b94-a96c-9928030724ac-kube-api-access-8qsqk" (OuterVolumeSpecName: "kube-api-access-8qsqk") pod "eef967a8-3dc1-4b94-a96c-9928030724ac" (UID: "eef967a8-3dc1-4b94-a96c-9928030724ac"). InnerVolumeSpecName "kube-api-access-8qsqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:51:54.198335 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.198287    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-console-config\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:51:54.198335 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.198327    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-serving-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:51:54.198335 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.198337    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef967a8-3dc1-4b94-a96c-9928030724ac-console-oauth-config\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:51:54.198335 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.198346    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qsqk\" (UniqueName: \"kubernetes.io/projected/eef967a8-3dc1-4b94-a96c-9928030724ac-kube-api-access-8qsqk\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:51:54.198335 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.198355    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef967a8-3dc1-4b94-a96c-9928030724ac-oauth-serving-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:51:54.615459 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.615421    2579 generic.go:356] "Generic (PLEG): container finished" podID="eef967a8-3dc1-4b94-a96c-9928030724ac" containerID="368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722" exitCode=0
Jul 14 07:51:54.615642 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.615464    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74677fbff8-qp8sl"
Jul 14 07:51:54.615642 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.615473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74677fbff8-qp8sl" event={"ID":"eef967a8-3dc1-4b94-a96c-9928030724ac","Type":"ContainerDied","Data":"368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722"}
Jul 14 07:51:54.615642 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.615514    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74677fbff8-qp8sl" event={"ID":"eef967a8-3dc1-4b94-a96c-9928030724ac","Type":"ContainerDied","Data":"0556b06e9dff161b34ff6dd5a7d06676051d047e731117cd31c6b6a24df889d0"}
Jul 14 07:51:54.615642 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.615546    2579 scope.go:117] "RemoveContainer" containerID="368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722"
Jul 14 07:51:54.628604 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.628506    2579 scope.go:117] "RemoveContainer" containerID="368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722"
Jul 14 07:51:54.629026 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:51:54.628938    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722\": container with ID starting with 368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722 not found: ID does not exist" containerID="368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722"
Jul 14 07:51:54.629026 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.628975    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722"} err="failed to get container status \"368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722\": rpc error: code = NotFound desc = could not find container \"368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722\": container with ID starting with 368cd14a6c882cd3cddee7003540323fbb75f0dcdfded289b841106ebe4de722 not found: ID does not exist"
Jul 14 07:51:54.639357 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.639330    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74677fbff8-qp8sl"]
Jul 14 07:51:54.642784 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.642760    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74677fbff8-qp8sl"]
Jul 14 07:51:54.984404 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:51:54.984373    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef967a8-3dc1-4b94-a96c-9928030724ac" path="/var/lib/kubelet/pods/eef967a8-3dc1-4b94-a96c-9928030724ac/volumes"
Jul 14 07:52:03.808946 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:03.808916    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:52:03.812820 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:03.812796    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6575f78bff-nwvp2"
Jul 14 07:52:04.633363 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.633297    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8697bdc78d-m8tbw" podUID="4782a79e-8c10-45dc-bf89-e46d3855a7e8" containerName="console" containerID="cri-o://734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a" gracePeriod=15
Jul 14 07:52:04.903589 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.903562    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:52:04.995960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.995932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-serving-cert\") pod \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") "
Jul 14 07:52:04.996167 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.995979    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-config\") pod \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") "
Jul 14 07:52:04.996167 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996014    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-oauth-config\") pod \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") "
Jul 14 07:52:04.996167 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996117    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-oauth-serving-cert\") pod \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") "
Jul 14 07:52:04.996344 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996175    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-service-ca\") pod \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") "
Jul 14 07:52:04.996344 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996233    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-trusted-ca-bundle\") pod \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") "
Jul 14 07:52:04.996344 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996264    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkhfq\" (UniqueName: \"kubernetes.io/projected/4782a79e-8c10-45dc-bf89-e46d3855a7e8-kube-api-access-jkhfq\") pod \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\" (UID: \"4782a79e-8c10-45dc-bf89-e46d3855a7e8\") "
Jul 14 07:52:04.996552 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996521    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-config" (OuterVolumeSpecName: "console-config") pod "4782a79e-8c10-45dc-bf89-e46d3855a7e8" (UID: "4782a79e-8c10-45dc-bf89-e46d3855a7e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:52:04.996680 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996555    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4782a79e-8c10-45dc-bf89-e46d3855a7e8" (UID: "4782a79e-8c10-45dc-bf89-e46d3855a7e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:52:04.996680 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996617    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "4782a79e-8c10-45dc-bf89-e46d3855a7e8" (UID: "4782a79e-8c10-45dc-bf89-e46d3855a7e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:52:04.996792 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.996700    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4782a79e-8c10-45dc-bf89-e46d3855a7e8" (UID: "4782a79e-8c10-45dc-bf89-e46d3855a7e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:52:04.998332 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.998280    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4782a79e-8c10-45dc-bf89-e46d3855a7e8" (UID: "4782a79e-8c10-45dc-bf89-e46d3855a7e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:52:04.998423 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.998366    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4782a79e-8c10-45dc-bf89-e46d3855a7e8" (UID: "4782a79e-8c10-45dc-bf89-e46d3855a7e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:52:04.998423 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:04.998368    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4782a79e-8c10-45dc-bf89-e46d3855a7e8-kube-api-access-jkhfq" (OuterVolumeSpecName: "kube-api-access-jkhfq") pod "4782a79e-8c10-45dc-bf89-e46d3855a7e8" (UID: "4782a79e-8c10-45dc-bf89-e46d3855a7e8"). InnerVolumeSpecName "kube-api-access-jkhfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:52:05.096819 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.096785    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-trusted-ca-bundle\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:52:05.096819 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.096811    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkhfq\" (UniqueName: \"kubernetes.io/projected/4782a79e-8c10-45dc-bf89-e46d3855a7e8-kube-api-access-jkhfq\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:52:05.096819 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.096822    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-serving-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:52:05.097066 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.096832    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-config\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:52:05.097066 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.096841    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4782a79e-8c10-45dc-bf89-e46d3855a7e8-console-oauth-config\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:52:05.097066 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.096849    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-oauth-serving-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:52:05.097066 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.096858    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4782a79e-8c10-45dc-bf89-e46d3855a7e8-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:52:05.662184 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.662147    2579 generic.go:356] "Generic (PLEG): container finished" podID="4782a79e-8c10-45dc-bf89-e46d3855a7e8" containerID="734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a" exitCode=0
Jul 14 07:52:05.662356 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.662199    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697bdc78d-m8tbw"
Jul 14 07:52:05.662356 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.662201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697bdc78d-m8tbw" event={"ID":"4782a79e-8c10-45dc-bf89-e46d3855a7e8","Type":"ContainerDied","Data":"734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a"}
Jul 14 07:52:05.662356 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.662249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697bdc78d-m8tbw" event={"ID":"4782a79e-8c10-45dc-bf89-e46d3855a7e8","Type":"ContainerDied","Data":"a287957c9eec4179b2129d2ef10fe9b79523b10a9c80d8dd63be8a0f6282a4ce"}
Jul 14 07:52:05.662356 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.662278    2579 scope.go:117] "RemoveContainer" containerID="734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a"
Jul 14 07:52:05.670507 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.670487    2579 scope.go:117] "RemoveContainer" containerID="734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a"
Jul 14 07:52:05.670801 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:52:05.670782    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a\": container with ID starting with 734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a not found: ID does not exist" containerID="734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a"
Jul 14 07:52:05.670858 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.670810    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a"} err="failed to get container status \"734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a\": rpc error: code = NotFound desc = could not find container \"734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a\": container with ID starting with 734e1c75eceb71784a87e53006f04c6d665e17fe228666cd9928b104411b3b8a not found: ID does not exist"
Jul 14 07:52:05.682404 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.682378    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8697bdc78d-m8tbw"]
Jul 14 07:52:05.685965 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:05.685943    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8697bdc78d-m8tbw"]
Jul 14 07:52:06.984252 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:06.984220    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4782a79e-8c10-45dc-bf89-e46d3855a7e8" path="/var/lib/kubelet/pods/4782a79e-8c10-45dc-bf89-e46d3855a7e8/volumes"
Jul 14 07:52:23.877203 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:23.877163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:25.789348 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:25.789304    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:52:25.808755 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:25.808723    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:52:26.755980 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:26.755951    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 07:52:35.311264 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:35.311230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:35.369321 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:35.369287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:38.960563 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.960529    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6975d7bcfc-dp272"]
Jul 14 07:52:38.960960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.960848    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4782a79e-8c10-45dc-bf89-e46d3855a7e8" containerName="console"
Jul 14 07:52:38.960960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.960862    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4782a79e-8c10-45dc-bf89-e46d3855a7e8" containerName="console"
Jul 14 07:52:38.960960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.960875    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef967a8-3dc1-4b94-a96c-9928030724ac" containerName="console"
Jul 14 07:52:38.960960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.960881    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef967a8-3dc1-4b94-a96c-9928030724ac" containerName="console"
Jul 14 07:52:38.960960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.960925    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef967a8-3dc1-4b94-a96c-9928030724ac" containerName="console"
Jul 14 07:52:38.960960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.960933    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4782a79e-8c10-45dc-bf89-e46d3855a7e8" containerName="console"
Jul 14 07:52:38.963340 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.963320    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:38.974839 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.974813    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6975d7bcfc-dp272"]
Jul 14 07:52:38.980981 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.980951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-oauth-serving-cert\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:38.981163 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.980993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-service-ca\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:38.981163 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.981052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-trusted-ca-bundle\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:38.981163 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.981095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4m4\" (UniqueName: \"kubernetes.io/projected/9d79ff63-6904-4b78-9837-8f9587976501-kube-api-access-gj4m4\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:38.981345 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.981195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-oauth-config\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:38.981345 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.981223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-console-config\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:38.981345 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:38.981260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-serving-cert\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.035493 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.035456    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:39.082257 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.082224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-oauth-config\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.082257 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.082258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-console-config\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.082444 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.082317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-serving-cert\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.082444 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.082372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-oauth-serving-cert\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.082444 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.082397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-service-ca\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.082444 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.082423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-trusted-ca-bundle\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.082632 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.082455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4m4\" (UniqueName: \"kubernetes.io/projected/9d79ff63-6904-4b78-9837-8f9587976501-kube-api-access-gj4m4\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.083284 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.083256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-service-ca\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.083284 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.083259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-console-config\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.083461 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.083321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-trusted-ca-bundle\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.083461 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.083343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-oauth-serving-cert\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.084958 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.084933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-oauth-config\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.085094 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.084992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-serving-cert\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.094142 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.094113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4m4\" (UniqueName: \"kubernetes.io/projected/9d79ff63-6904-4b78-9837-8f9587976501-kube-api-access-gj4m4\") pod \"console-6975d7bcfc-dp272\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") " pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.105947 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.105904    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:39.162185 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.162153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:39.272175 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.272133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:39.399939 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.399912    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6975d7bcfc-dp272"]
Jul 14 07:52:39.402513 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:52:39.402487    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d79ff63_6904_4b78_9837_8f9587976501.slice/crio-f61d0c745f7bb4c74f01e0e93255bc4d0ab4ca54a3c1fc99d84ed3e3ecca52c9 WatchSource:0}: Error finding container f61d0c745f7bb4c74f01e0e93255bc4d0ab4ca54a3c1fc99d84ed3e3ecca52c9: Status 404 returned error can't find the container with id f61d0c745f7bb4c74f01e0e93255bc4d0ab4ca54a3c1fc99d84ed3e3ecca52c9
Jul 14 07:52:39.775288 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.775255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:39.795748 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.795712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6975d7bcfc-dp272" event={"ID":"9d79ff63-6904-4b78-9837-8f9587976501","Type":"ContainerStarted","Data":"72791257e7b33724a9e00b959c639ac2816974424d666ffa4e464f2269b9c366"}
Jul 14 07:52:39.795937 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.795762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6975d7bcfc-dp272" event={"ID":"9d79ff63-6904-4b78-9837-8f9587976501","Type":"ContainerStarted","Data":"f61d0c745f7bb4c74f01e0e93255bc4d0ab4ca54a3c1fc99d84ed3e3ecca52c9"}
Jul 14 07:52:39.813644 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.813590    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6975d7bcfc-dp272" podStartSLOduration=1.81357211 podStartE2EDuration="1.81357211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:52:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:52:39.812323986 +0000 UTC m=+155.391330326" watchObservedRunningTime="2026-07-14 07:52:39.81357211 +0000 UTC m=+155.392578449"
Jul 14 07:52:39.877246 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:39.877215    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:47.255129 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:47.255091    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:47.309860 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:47.309811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:49.272763 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:49.272733    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:49.273180 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:49.272789    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:49.277526 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:49.277503    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:49.837267 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:49.837237    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:52:49.876275 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:49.876241    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f696556bc-t7n54"]
Jul 14 07:52:49.982747 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:49.982710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:50.034186 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:50.034159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:52:50.088649 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:52:50.088566    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:01.495815 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:01.495741    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:01.597192 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:01.597159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:14.902102 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:14.902022    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f696556bc-t7n54" podUID="331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" containerName="console" containerID="cri-o://63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85" gracePeriod=15
Jul 14 07:53:15.152457 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.152395    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:53:15.197725 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.197688    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpzp8\" (UniqueName: \"kubernetes.io/projected/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-kube-api-access-rpzp8\") pod \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") "
Jul 14 07:53:15.197912 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.197743    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-oauth-serving-cert\") pod \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") "
Jul 14 07:53:15.197912 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.197763    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-trusted-ca-bundle\") pod \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") "
Jul 14 07:53:15.197912 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.197791    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-serving-cert\") pod \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") "
Jul 14 07:53:15.197912 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.197809    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-service-ca\") pod \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") "
Jul 14 07:53:15.197912 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.197843    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-config\") pod \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") "
Jul 14 07:53:15.198246 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198212    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" (UID: "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:53:15.198318 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198240    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" (UID: "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:53:15.198318 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198242    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-config" (OuterVolumeSpecName: "console-config") pod "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" (UID: "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:53:15.198318 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198280    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-service-ca" (OuterVolumeSpecName: "service-ca") pod "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" (UID: "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:53:15.198318 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198288    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-oauth-config\") pod \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\" (UID: \"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8\") "
Jul 14 07:53:15.198551 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198534    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-oauth-serving-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:53:15.198612 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198559    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-trusted-ca-bundle\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:53:15.198612 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198574    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:53:15.198612 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.198590    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-config\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:53:15.199941 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.199923    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" (UID: "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:53:15.199941 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.199928    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-kube-api-access-rpzp8" (OuterVolumeSpecName: "kube-api-access-rpzp8") pod "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" (UID: "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8"). InnerVolumeSpecName "kube-api-access-rpzp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:53:15.200279 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.200261    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" (UID: "331c2d5f-23e1-4ca7-9180-66ec38bc6fb8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:53:15.299296 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.299261    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpzp8\" (UniqueName: \"kubernetes.io/projected/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-kube-api-access-rpzp8\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:53:15.299296 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.299286    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-serving-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:53:15.299296 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.299295    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8-console-oauth-config\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:53:15.926974 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.926939    2579 generic.go:356] "Generic (PLEG): container finished" podID="331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" containerID="63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85" exitCode=0
Jul 14 07:53:15.927413 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.926990    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f696556bc-t7n54"
Jul 14 07:53:15.927413 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.927023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f696556bc-t7n54" event={"ID":"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8","Type":"ContainerDied","Data":"63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85"}
Jul 14 07:53:15.927413 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.927091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f696556bc-t7n54" event={"ID":"331c2d5f-23e1-4ca7-9180-66ec38bc6fb8","Type":"ContainerDied","Data":"41d1ea6da4c7a525425af1c864255b21583119a0ac49397ee5963ba2396c1636"}
Jul 14 07:53:15.927413 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.927114    2579 scope.go:117] "RemoveContainer" containerID="63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85"
Jul 14 07:53:15.935326 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.935311    2579 scope.go:117] "RemoveContainer" containerID="63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85"
Jul 14 07:53:15.935589 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:53:15.935571    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85\": container with ID starting with 63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85 not found: ID does not exist" containerID="63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85"
Jul 14 07:53:15.935640 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.935600    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85"} err="failed to get container status \"63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85\": rpc error: code = NotFound desc = could not find container \"63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85\": container with ID starting with 63253e927ba71a0f098955b2b81140dd1360749e20d5d466000a2a9670feaf85 not found: ID does not exist"
Jul 14 07:53:15.951751 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.951713    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f696556bc-t7n54"]
Jul 14 07:53:15.953169 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:15.953147    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f696556bc-t7n54"]
Jul 14 07:53:16.984113 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:16.984078    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" path="/var/lib/kubelet/pods/331c2d5f-23e1-4ca7-9180-66ec38bc6fb8/volumes"
Jul 14 07:53:19.769455 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:19.769421    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:19.823946 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:19.823915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:35.423509 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:35.423475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:35.520385 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:35.520352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:50.967283 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:50.967243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:57.081160 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:57.081123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:53:58.054380 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:53:58.054344    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:00.711281 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:00.711245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:00.810167 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:00.810136    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:02.002840 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:02.002801    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:02.106621 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:02.106589    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:02.489292 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:02.489261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:02.595874 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:02.595842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:04.492719 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:04.492686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:04.935554 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:04.935514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:07.486753 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:07.486720    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:07.550228 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:07.550189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:13.096923 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:13.096890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:18.747452 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:18.747414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:18.803875 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:18.803847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:25.348517 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:25.348483    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:25.408676 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:25.408644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:26.588920 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:26.588841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:26.685244 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:26.685211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:28.304756 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.304719    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"]
Jul 14 07:54:28.305163 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.304986    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" containerName="console"
Jul 14 07:54:28.305163 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.304996    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" containerName="console"
Jul 14 07:54:28.305163 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.305069    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="331c2d5f-23e1-4ca7-9180-66ec38bc6fb8" containerName="console"
Jul 14 07:54:28.306858 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.306843    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"
Jul 14 07:54:28.309642 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.309624    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 07:54:28.309706 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.309641    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 07:54:28.310634 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.310617    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tw7jt\""
Jul 14 07:54:28.315802 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.315778    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"]
Jul 14 07:54:28.396721 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.396681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1d936aa-2983-4ebd-9c90-4862ecd909e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zkjwd\" (UID: \"a1d936aa-2983-4ebd-9c90-4862ecd909e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"
Jul 14 07:54:28.396721 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.396723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8fws\" (UniqueName: \"kubernetes.io/projected/a1d936aa-2983-4ebd-9c90-4862ecd909e4-kube-api-access-x8fws\") pod \"openshift-lws-operator-fd8ccff4c-zkjwd\" (UID: \"a1d936aa-2983-4ebd-9c90-4862ecd909e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"
Jul 14 07:54:28.497562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.497528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8fws\" (UniqueName: \"kubernetes.io/projected/a1d936aa-2983-4ebd-9c90-4862ecd909e4-kube-api-access-x8fws\") pod \"openshift-lws-operator-fd8ccff4c-zkjwd\" (UID: \"a1d936aa-2983-4ebd-9c90-4862ecd909e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"
Jul 14 07:54:28.497736 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.497607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1d936aa-2983-4ebd-9c90-4862ecd909e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zkjwd\" (UID: \"a1d936aa-2983-4ebd-9c90-4862ecd909e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"
Jul 14 07:54:28.497969 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.497952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1d936aa-2983-4ebd-9c90-4862ecd909e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zkjwd\" (UID: \"a1d936aa-2983-4ebd-9c90-4862ecd909e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"
Jul 14 07:54:28.507912 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.507883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8fws\" (UniqueName: \"kubernetes.io/projected/a1d936aa-2983-4ebd-9c90-4862ecd909e4-kube-api-access-x8fws\") pod \"openshift-lws-operator-fd8ccff4c-zkjwd\" (UID: \"a1d936aa-2983-4ebd-9c90-4862ecd909e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"
Jul 14 07:54:28.624082 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.623959    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"
Jul 14 07:54:28.757141 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:28.757090    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd"]
Jul 14 07:54:28.759821 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:54:28.759794    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1d936aa_2983_4ebd_9c90_4862ecd909e4.slice/crio-e694baf78758d8d709015133d5192a38051019cdff29bc64f238d8e2504e8970 WatchSource:0}: Error finding container e694baf78758d8d709015133d5192a38051019cdff29bc64f238d8e2504e8970: Status 404 returned error can't find the container with id e694baf78758d8d709015133d5192a38051019cdff29bc64f238d8e2504e8970
Jul 14 07:54:29.185020 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:29.184978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd" event={"ID":"a1d936aa-2983-4ebd-9c90-4862ecd909e4","Type":"ContainerStarted","Data":"e694baf78758d8d709015133d5192a38051019cdff29bc64f238d8e2504e8970"}
Jul 14 07:54:32.199212 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:32.199175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd" event={"ID":"a1d936aa-2983-4ebd-9c90-4862ecd909e4","Type":"ContainerStarted","Data":"0889132b1a354d37116cde569b344f3e2e7cf4b747ad1054505e6ac6ef968220"}
Jul 14 07:54:32.216865 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:32.216796    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zkjwd" podStartSLOduration=1.262854154 podStartE2EDuration="4.21677317s" totalImagesPullingTime="2.953919016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:32.215746739 +0000 UTC m=+267.794753076" watchObservedRunningTime="2026-07-14 07:54:32.21677317 +0000 UTC m=+267.795779512"
Jul 14 07:54:33.043668 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:33.043638    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:33.144362 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:33.144331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:35.045629 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:35.045584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:45.263969 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.263915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:45.312138 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.312104    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"]
Jul 14 07:54:45.314366 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.314344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.317190 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.317162    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 07:54:45.317896 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.317872    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 07:54:45.317896 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.317895    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z5q6c\""
Jul 14 07:54:45.318098 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.317927    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 07:54:45.324876 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.324850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"]
Jul 14 07:54:45.446764 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.446728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99adf0a4-900f-483d-b9cf-1640e3495b2a-metrics-cert\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.446764 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.446767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g52zr\" (UniqueName: \"kubernetes.io/projected/99adf0a4-900f-483d-b9cf-1640e3495b2a-kube-api-access-g52zr\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.446999 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.446810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99adf0a4-900f-483d-b9cf-1640e3495b2a-manager-config\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.446999 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.446869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99adf0a4-900f-483d-b9cf-1640e3495b2a-cert\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.547650 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.547550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99adf0a4-900f-483d-b9cf-1640e3495b2a-metrics-cert\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.547650 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.547586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g52zr\" (UniqueName: \"kubernetes.io/projected/99adf0a4-900f-483d-b9cf-1640e3495b2a-kube-api-access-g52zr\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.547650 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.547617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99adf0a4-900f-483d-b9cf-1640e3495b2a-manager-config\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.547946 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.547663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99adf0a4-900f-483d-b9cf-1640e3495b2a-cert\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.548443 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.548423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99adf0a4-900f-483d-b9cf-1640e3495b2a-manager-config\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.550072 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.550050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99adf0a4-900f-483d-b9cf-1640e3495b2a-metrics-cert\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.550165 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.550105    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99adf0a4-900f-483d-b9cf-1640e3495b2a-cert\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.557537 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.557511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g52zr\" (UniqueName: \"kubernetes.io/projected/99adf0a4-900f-483d-b9cf-1640e3495b2a-kube-api-access-g52zr\") pod \"lws-controller-manager-67649569dd-9sfrs\" (UID: \"99adf0a4-900f-483d-b9cf-1640e3495b2a\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.624593 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.624554    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:54:45.758168 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:45.758135    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"]
Jul 14 07:54:45.761593 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:54:45.761558    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99adf0a4_900f_483d_b9cf_1640e3495b2a.slice/crio-1f0e765a8d4b614d3fbb8418882278c1e19563a9d39ab736942456cb0e3a5070 WatchSource:0}: Error finding container 1f0e765a8d4b614d3fbb8418882278c1e19563a9d39ab736942456cb0e3a5070: Status 404 returned error can't find the container with id 1f0e765a8d4b614d3fbb8418882278c1e19563a9d39ab736942456cb0e3a5070
Jul 14 07:54:46.251860 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:46.251822    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs" event={"ID":"99adf0a4-900f-483d-b9cf-1640e3495b2a","Type":"ContainerStarted","Data":"1f0e765a8d4b614d3fbb8418882278c1e19563a9d39ab736942456cb0e3a5070"}
Jul 14 07:54:46.497831 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:46.497798    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:50.760694 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:50.760659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:50.856490 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:50.856452    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:51.354229 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.354192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:51.517877 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.517847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:51.644076 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.643971    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:51.723174 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.723140    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"]
Jul 14 07:54:51.728234 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.728205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:51.731264 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.731236    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xkkrl\""
Jul 14 07:54:51.731411 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.731244    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 07:54:51.731411 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.731389    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 07:54:51.731999 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.731986    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 07:54:51.732031 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.731993    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 07:54:51.749974 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.749945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"]
Jul 14 07:54:51.845798 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.845764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:51.902800 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.902728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3dfd42c7-5169-4300-afb4-0855b1cb78ed-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:51.902800 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.902769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn7m4\" (UniqueName: \"kubernetes.io/projected/3dfd42c7-5169-4300-afb4-0855b1cb78ed-kube-api-access-kn7m4\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:51.902932 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.902800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dfd42c7-5169-4300-afb4-0855b1cb78ed-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:51.902932 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.902871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3dfd42c7-5169-4300-afb4-0855b1cb78ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:51.902932 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.902919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dfd42c7-5169-4300-afb4-0855b1cb78ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:51.946547 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:51.946490    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:52.003831 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.003793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3dfd42c7-5169-4300-afb4-0855b1cb78ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.004134 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.003857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dfd42c7-5169-4300-afb4-0855b1cb78ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.004134 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.003911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3dfd42c7-5169-4300-afb4-0855b1cb78ed-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.004134 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.003957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn7m4\" (UniqueName: \"kubernetes.io/projected/3dfd42c7-5169-4300-afb4-0855b1cb78ed-kube-api-access-kn7m4\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.004134 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.004000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dfd42c7-5169-4300-afb4-0855b1cb78ed-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.004361 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.004340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3dfd42c7-5169-4300-afb4-0855b1cb78ed-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.006325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.006297    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dfd42c7-5169-4300-afb4-0855b1cb78ed-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.006438 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.006385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3dfd42c7-5169-4300-afb4-0855b1cb78ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.006475 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.006465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dfd42c7-5169-4300-afb4-0855b1cb78ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.011936 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.011908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn7m4\" (UniqueName: \"kubernetes.io/projected/3dfd42c7-5169-4300-afb4-0855b1cb78ed-kube-api-access-kn7m4\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-r66q8\" (UID: \"3dfd42c7-5169-4300-afb4-0855b1cb78ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.039222 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.039179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:52.047552 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.047519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:52.147857 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.147799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:52.174286 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.174208    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"]
Jul 14 07:54:52.177631 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:54:52.177603    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dfd42c7_5169_4300_afb4_0855b1cb78ed.slice/crio-7227535ee0d1e660bf0c457afcf8ca0e3b48adec0ac1d3c72df8d29459ff8ffc WatchSource:0}: Error finding container 7227535ee0d1e660bf0c457afcf8ca0e3b48adec0ac1d3c72df8d29459ff8ffc: Status 404 returned error can't find the container with id 7227535ee0d1e660bf0c457afcf8ca0e3b48adec0ac1d3c72df8d29459ff8ffc
Jul 14 07:54:52.248747 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.248714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:52.279227 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.279194    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8" event={"ID":"3dfd42c7-5169-4300-afb4-0855b1cb78ed","Type":"ContainerStarted","Data":"7227535ee0d1e660bf0c457afcf8ca0e3b48adec0ac1d3c72df8d29459ff8ffc"}
Jul 14 07:54:52.347986 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.347956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:52.448804 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:52.448721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:54:55.294990 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:55.294958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8" event={"ID":"3dfd42c7-5169-4300-afb4-0855b1cb78ed","Type":"ContainerStarted","Data":"5f63f7fdf67fe3785edc7082f44e16074a0af14b9add473ceb18632ffbdddeff"}
Jul 14 07:54:56.300019 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:56.299983    2579 generic.go:356] "Generic (PLEG): container finished" podID="3dfd42c7-5169-4300-afb4-0855b1cb78ed" containerID="5f63f7fdf67fe3785edc7082f44e16074a0af14b9add473ceb18632ffbdddeff" exitCode=0
Jul 14 07:54:56.300424 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:56.300030    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8" event={"ID":"3dfd42c7-5169-4300-afb4-0855b1cb78ed","Type":"ContainerDied","Data":"5f63f7fdf67fe3785edc7082f44e16074a0af14b9add473ceb18632ffbdddeff"}
Jul 14 07:54:57.305668 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:57.305633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8" event={"ID":"3dfd42c7-5169-4300-afb4-0855b1cb78ed","Type":"ContainerStarted","Data":"c0f74fbdf860606f8cc6b9dd58dced9c0d0302abd5f2527c7200b16aca552819"}
Jul 14 07:54:57.306092 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:57.305741    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:54:57.328881 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:54:57.328820    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8" podStartSLOduration=2.000087985 podStartE2EDuration="6.328802769s" totalImagesPullingTime="3.235820689s" totalInitContainerRuntime="1.092894095s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:57.326489651 +0000 UTC m=+292.905496030" watchObservedRunningTime="2026-07-14 07:54:57.328802769 +0000 UTC m=+292.907809110"
Jul 14 07:55:00.319700 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:00.319659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs" event={"ID":"99adf0a4-900f-483d-b9cf-1640e3495b2a","Type":"ContainerStarted","Data":"ab95dfcd7889d88339bc763f868b25183ae8738d7b9eadd24e91c0c85dc5d638"}
Jul 14 07:55:00.320126 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:00.319796    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:55:00.339976 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:00.339925    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs" podStartSLOduration=1.3983712 podStartE2EDuration="15.339909892s" totalImagesPullingTime="13.941538692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:00.338774914 +0000 UTC m=+295.917781266" watchObservedRunningTime="2026-07-14 07:55:00.339909892 +0000 UTC m=+295.918916231"
Jul 14 07:55:04.170417 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:04.170383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:04.270548 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:04.270510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:04.815857 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:04.815828    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 07:55:04.816775 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:04.816756    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 07:55:04.824518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:04.824493    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 07:55:08.311985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:08.311950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-r66q8"
Jul 14 07:55:10.498462 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:10.498409    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:10.625128 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:10.625090    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:11.326114 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.326090    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67649569dd-9sfrs"
Jul 14 07:55:11.822432 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.822385    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:11.925004 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.924971    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"]
Jul 14 07:55:11.928090 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.928071    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:11.935526 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.935496    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 07:55:11.936421 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.936370    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 07:55:11.936744 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.936726    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cwqq7\""
Jul 14 07:55:11.936864 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.936809    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 07:55:11.937213 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.937194    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 07:55:11.952195 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.952147    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"]
Jul 14 07:55:11.964248 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.964211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9d4p\" (UniqueName: \"kubernetes.io/projected/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-kube-api-access-z9d4p\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:11.964418 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.964302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-tls-certs\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:11.964418 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:11.964341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-tmp\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:12.064964 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.064927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9d4p\" (UniqueName: \"kubernetes.io/projected/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-kube-api-access-z9d4p\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:12.065198 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.064995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-tls-certs\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:12.065198 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.065059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-tmp\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:12.067345 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.067320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-tmp\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:12.067550 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.067531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-tls-certs\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:12.083627 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.083548    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9d4p\" (UniqueName: \"kubernetes.io/projected/fbfdcab9-16fe-47c0-a4e8-507d52db0f08-kube-api-access-z9d4p\") pod \"kube-auth-proxy-7b677bd8c7-dxpbt\" (UID: \"fbfdcab9-16fe-47c0-a4e8-507d52db0f08\") " pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:12.121394 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.121325    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:12.192315 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.192281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:12.239927 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.239894    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"
Jul 14 07:55:12.293029 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.292919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:12.375985 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.375900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:12.380197 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.380169    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt"]
Jul 14 07:55:12.383452 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:55:12.383426    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfdcab9_16fe_47c0_a4e8_507d52db0f08.slice/crio-2f535ebc0ae9e787edfc4774b949d827275ee501b93c22f553e4bff68c4c2f2b WatchSource:0}: Error finding container 2f535ebc0ae9e787edfc4774b949d827275ee501b93c22f553e4bff68c4c2f2b: Status 404 returned error can't find the container with id 2f535ebc0ae9e787edfc4774b949d827275ee501b93c22f553e4bff68c4c2f2b
Jul 14 07:55:12.385248 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.385234    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 07:55:12.459254 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.459219    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:12.840641 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:12.840605    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:13.110337 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:13.110242    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:13.190005 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:13.189974    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:13.263706 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:13.263624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:13.375812 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:13.375731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt" event={"ID":"fbfdcab9-16fe-47c0-a4e8-507d52db0f08","Type":"ContainerStarted","Data":"2f535ebc0ae9e787edfc4774b949d827275ee501b93c22f553e4bff68c4c2f2b"}
Jul 14 07:55:13.505395 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:13.505339    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:14.171188 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:14.171151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:15.386739 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:15.386646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt" event={"ID":"fbfdcab9-16fe-47c0-a4e8-507d52db0f08","Type":"ContainerStarted","Data":"51a6d801711ed3352ab2c2a8f5ea269192794ed7c3199b0ed4e489e2c1b80b63"}
Jul 14 07:55:15.402934 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:15.402878    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b677bd8c7-dxpbt" podStartSLOduration=1.73078706 podStartE2EDuration="4.402855867s" totalImagesPullingTime="2.672068807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:15.402275141 +0000 UTC m=+310.981281481" watchObservedRunningTime="2026-07-14 07:55:15.402855867 +0000 UTC m=+310.981862207"
Jul 14 07:55:19.464279 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:19.464247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:19.628850 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:19.628813    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:19.850949 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:19.850903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:20.120503 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:20.120407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:20.237177 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:20.237137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:22.974669 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:22.974629    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:23.040388 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.040352    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"]
Jul 14 07:55:23.044623 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.044602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:23.048510 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.048483    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 14 07:55:23.048639 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.048571    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-55wq2\""
Jul 14 07:55:23.054229 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.054199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"]
Jul 14 07:55:23.072224 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.072164    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:23.160460 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.160416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr2cf\" (UniqueName: \"kubernetes.io/projected/0869c527-08bb-47f0-8364-68fe17acf08b-kube-api-access-pr2cf\") pod \"kserve-controller-manager-d6f4b65b8-bnghd\" (UID: \"0869c527-08bb-47f0-8364-68fe17acf08b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:23.160652 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.160494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0869c527-08bb-47f0-8364-68fe17acf08b-cert\") pod \"kserve-controller-manager-d6f4b65b8-bnghd\" (UID: \"0869c527-08bb-47f0-8364-68fe17acf08b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:23.260982 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.260902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr2cf\" (UniqueName: \"kubernetes.io/projected/0869c527-08bb-47f0-8364-68fe17acf08b-kube-api-access-pr2cf\") pod \"kserve-controller-manager-d6f4b65b8-bnghd\" (UID: \"0869c527-08bb-47f0-8364-68fe17acf08b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:23.261158 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.260978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0869c527-08bb-47f0-8364-68fe17acf08b-cert\") pod \"kserve-controller-manager-d6f4b65b8-bnghd\" (UID: \"0869c527-08bb-47f0-8364-68fe17acf08b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:23.261158 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:55:23.261127    2579 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 14 07:55:23.261260 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:55:23.261199    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0869c527-08bb-47f0-8364-68fe17acf08b-cert podName:0869c527-08bb-47f0-8364-68fe17acf08b nodeName:}" failed. No retries permitted until 2026-07-14 07:55:23.76118097 +0000 UTC m=+319.340187291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0869c527-08bb-47f0-8364-68fe17acf08b-cert") pod "kserve-controller-manager-d6f4b65b8-bnghd" (UID: "0869c527-08bb-47f0-8364-68fe17acf08b") : secret "kserve-webhook-server-cert" not found
Jul 14 07:55:23.273439 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.273407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr2cf\" (UniqueName: \"kubernetes.io/projected/0869c527-08bb-47f0-8364-68fe17acf08b-kube-api-access-pr2cf\") pod \"kserve-controller-manager-d6f4b65b8-bnghd\" (UID: \"0869c527-08bb-47f0-8364-68fe17acf08b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:23.315749 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.315713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:23.444754 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.444719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:23.766227 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.766191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0869c527-08bb-47f0-8364-68fe17acf08b-cert\") pod \"kserve-controller-manager-d6f4b65b8-bnghd\" (UID: \"0869c527-08bb-47f0-8364-68fe17acf08b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:23.768601 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.768569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0869c527-08bb-47f0-8364-68fe17acf08b-cert\") pod \"kserve-controller-manager-d6f4b65b8-bnghd\" (UID: \"0869c527-08bb-47f0-8364-68fe17acf08b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:23.955777 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:23.955727    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:24.085512 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:24.085333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"]
Jul 14 07:55:24.088023 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:55:24.087997    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0869c527_08bb_47f0_8364_68fe17acf08b.slice/crio-a1725217ab2aaeb3e480e2844670d9f6ae3e38f6db95e3c83c080ae80cf4be34 WatchSource:0}: Error finding container a1725217ab2aaeb3e480e2844670d9f6ae3e38f6db95e3c83c080ae80cf4be34: Status 404 returned error can't find the container with id a1725217ab2aaeb3e480e2844670d9f6ae3e38f6db95e3c83c080ae80cf4be34
Jul 14 07:55:24.289017 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:24.288882    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:24.385868 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:24.385840    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:24.425351 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:24.425317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd" event={"ID":"0869c527-08bb-47f0-8364-68fe17acf08b","Type":"ContainerStarted","Data":"a1725217ab2aaeb3e480e2844670d9f6ae3e38f6db95e3c83c080ae80cf4be34"}
Jul 14 07:55:24.526551 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:24.526511    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:27.440553 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:27.440519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd" event={"ID":"0869c527-08bb-47f0-8364-68fe17acf08b","Type":"ContainerStarted","Data":"1e5b1c6a356699e3bd83dbda74feff8512f6247fa3012b862a0dfaa5c9542c9d"}
Jul 14 07:55:27.440938 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:27.440636    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:55:27.459827 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:27.459773    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd" podStartSLOduration=1.8375581539999999 podStartE2EDuration="4.459756049s" totalImagesPullingTime="2.622197895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:27.458319202 +0000 UTC m=+323.037325541" watchObservedRunningTime="2026-07-14 07:55:27.459756049 +0000 UTC m=+323.038762387"
Jul 14 07:55:29.770819 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:29.770781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:29.871923 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:29.871892    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:55:58.450251 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:55:58.450163    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bnghd"
Jul 14 07:56:11.960118 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:11.960028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:12.067211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:12.067171    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:12.163217 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:12.163174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:12.288655 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:12.288619    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:12.350746 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:12.350714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:14.240157 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:14.240109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:14.297742 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:14.297709    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:39.769211 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:39.769170    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:39.848429 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:39.848377    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:40.155983 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:40.155875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:43.531062 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:43.531003    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:45.090808 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:45.090756    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:45.499884 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:45.499811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:46.522986 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:46.522951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:46.624142 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:46.624108    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:48.123973 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:48.123941    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:48.224799 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:48.224739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:50.298504 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:50.298471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:51.033487 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:51.033457    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6975d7bcfc-dp272"]
Jul 14 07:56:51.221193 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:51.221159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:51.322653 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:51.322575    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:52.158790 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:52.158755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:53.963720 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:53.963686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:54.029669 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.029614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:54.280348 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.280317    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"]
Jul 14 07:56:54.283541 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.283523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.286804 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.286783    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 14 07:56:54.286927 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.286908    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 14 07:56:54.287185 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.287172    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 07:56:54.288015 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.287998    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 07:56:54.288106 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.288089    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7fh6g\""
Jul 14 07:56:54.295111 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.295087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"]
Jul 14 07:56:54.295495 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.295476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:54.446571 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.446524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb2s8\" (UniqueName: \"kubernetes.io/projected/a6c4a6c2-59ad-496b-8129-e245d44698c3-kube-api-access-xb2s8\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.446786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.446593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6c4a6c2-59ad-496b-8129-e245d44698c3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.446786 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.446663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c4a6c2-59ad-496b-8129-e245d44698c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.536577 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.536477    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:56:54.547683 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.547658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb2s8\" (UniqueName: \"kubernetes.io/projected/a6c4a6c2-59ad-496b-8129-e245d44698c3-kube-api-access-xb2s8\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.547768 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.547712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6c4a6c2-59ad-496b-8129-e245d44698c3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.547768 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.547743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c4a6c2-59ad-496b-8129-e245d44698c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.548407 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.548387    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6c4a6c2-59ad-496b-8129-e245d44698c3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.550206 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.550186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c4a6c2-59ad-496b-8129-e245d44698c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.556340 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.556316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb2s8\" (UniqueName: \"kubernetes.io/projected/a6c4a6c2-59ad-496b-8129-e245d44698c3-kube-api-access-xb2s8\") pod \"kuadrant-console-plugin-66b5774985-p7sqq\" (UID: \"a6c4a6c2-59ad-496b-8129-e245d44698c3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.593047 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.593012    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"
Jul 14 07:56:54.722812 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.722785    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq"]
Jul 14 07:56:54.725497 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:56:54.725474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6c4a6c2_59ad_496b_8129_e245d44698c3.slice/crio-04c9295cc17640a1dc1a9e071d55cd7b8b3fae8a88925c7c888f978c12298891 WatchSource:0}: Error finding container 04c9295cc17640a1dc1a9e071d55cd7b8b3fae8a88925c7c888f978c12298891: Status 404 returned error can't find the container with id 04c9295cc17640a1dc1a9e071d55cd7b8b3fae8a88925c7c888f978c12298891
Jul 14 07:56:54.803387 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:56:54.803297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq" event={"ID":"a6c4a6c2-59ad-496b-8129-e245d44698c3","Type":"ContainerStarted","Data":"04c9295cc17640a1dc1a9e071d55cd7b8b3fae8a88925c7c888f978c12298891"}
Jul 14 07:57:04.229190 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.229137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:04.325102 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.325073    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:04.716257 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.716225    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"]
Jul 14 07:57:04.726534 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.726495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:04.735379 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.735317    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-brnjk\""
Jul 14 07:57:04.738578 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.738551    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"]
Jul 14 07:57:04.788804 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.788773    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"]
Jul 14 07:57:04.789213 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:57:04.789182    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-bhpsd], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-bhpsd]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl" podUID="899f6407-84bd-4f82-8a99-afd53e969f8f"
Jul 14 07:57:04.795798 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.795536    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"]
Jul 14 07:57:04.852636 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.852606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:04.855715 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:57:04.855681    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-2fstl\" is forbidden: User \"system:node:ip-10-0-131-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-251.ec2.internal' and this object" podUID="899f6407-84bd-4f82-8a99-afd53e969f8f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:04.860024 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.859998    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:04.862534 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:57:04.862502    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-2fstl\" is forbidden: User \"system:node:ip-10-0-131-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-251.ec2.internal' and this object" podUID="899f6407-84bd-4f82-8a99-afd53e969f8f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:04.868462 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.868437    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"]
Jul 14 07:57:04.872080 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.872057    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"
Jul 14 07:57:04.877601 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:57:04.877569    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-2fstl\" is forbidden: User \"system:node:ip-10-0-131-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-251.ec2.internal' and this object" podUID="899f6407-84bd-4f82-8a99-afd53e969f8f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:04.878114 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.878095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9rjpf\""
Jul 14 07:57:04.893638 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.893548    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"]
Jul 14 07:57:04.933324 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:04.933285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qffjz\" (UniqueName: \"kubernetes.io/projected/9416fb35-8e8a-4cee-ac09-a27ad25c436b-kube-api-access-qffjz\") pod \"limitador-operator-controller-manager-859d7b78bd-6kmsj\" (UID: \"9416fb35-8e8a-4cee-ac09-a27ad25c436b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"
Jul 14 07:57:05.018441 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:57:05.018312    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-2fstl\" is forbidden: User \"system:node:ip-10-0-131-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-251.ec2.internal' and this object" podUID="899f6407-84bd-4f82-8a99-afd53e969f8f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:05.024083 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:05.023089    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899f6407-84bd-4f82-8a99-afd53e969f8f" path="/var/lib/kubelet/pods/899f6407-84bd-4f82-8a99-afd53e969f8f/volumes"
Jul 14 07:57:05.034408 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:05.034377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qffjz\" (UniqueName: \"kubernetes.io/projected/9416fb35-8e8a-4cee-ac09-a27ad25c436b-kube-api-access-qffjz\") pod \"limitador-operator-controller-manager-859d7b78bd-6kmsj\" (UID: \"9416fb35-8e8a-4cee-ac09-a27ad25c436b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"
Jul 14 07:57:05.044254 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:05.044221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qffjz\" (UniqueName: \"kubernetes.io/projected/9416fb35-8e8a-4cee-ac09-a27ad25c436b-kube-api-access-qffjz\") pod \"limitador-operator-controller-manager-859d7b78bd-6kmsj\" (UID: \"9416fb35-8e8a-4cee-ac09-a27ad25c436b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"
Jul 14 07:57:05.185533 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:05.185493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"
Jul 14 07:57:05.857596 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:05.857562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:05.863058 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:57:05.862994    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-2fstl\" is forbidden: User \"system:node:ip-10-0-131-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-251.ec2.internal' and this object" podUID="899f6407-84bd-4f82-8a99-afd53e969f8f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2fstl"
Jul 14 07:57:06.556193 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:06.556139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:06.655986 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:06.655932    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:11.354912 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:11.354852    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:11.455823 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:11.455780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:15.114210 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:15.114165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:15.214249 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:15.214214    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:16.054215 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:16.054171    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6975d7bcfc-dp272" podUID="9d79ff63-6904-4b78-9837-8f9587976501" containerName="console" containerID="cri-o://72791257e7b33724a9e00b959c639ac2816974424d666ffa4e464f2269b9c366" gracePeriod=15
Jul 14 07:57:17.916944 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:17.916900    2579 generic.go:356] "Generic (PLEG): container finished" podID="9d79ff63-6904-4b78-9837-8f9587976501" containerID="72791257e7b33724a9e00b959c639ac2816974424d666ffa4e464f2269b9c366" exitCode=0
Jul 14 07:57:17.917439 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:17.916953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6975d7bcfc-dp272" event={"ID":"9d79ff63-6904-4b78-9837-8f9587976501","Type":"ContainerDied","Data":"72791257e7b33724a9e00b959c639ac2816974424d666ffa4e464f2269b9c366"}
Jul 14 07:57:18.022261 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.022235    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:57:18.028416 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.028379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"]
Jul 14 07:57:18.031853 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:57:18.031827    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9416fb35_8e8a_4cee_ac09_a27ad25c436b.slice/crio-82ff07c069c64c3e3534e9f97f8945a0f32872cd36bd3b7d37713dccad89a9a5 WatchSource:0}: Error finding container 82ff07c069c64c3e3534e9f97f8945a0f32872cd36bd3b7d37713dccad89a9a5: Status 404 returned error can't find the container with id 82ff07c069c64c3e3534e9f97f8945a0f32872cd36bd3b7d37713dccad89a9a5
Jul 14 07:57:18.155835 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.155745    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-trusted-ca-bundle\") pod \"9d79ff63-6904-4b78-9837-8f9587976501\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") "
Jul 14 07:57:18.155835 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.155793    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-console-config\") pod \"9d79ff63-6904-4b78-9837-8f9587976501\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") "
Jul 14 07:57:18.156059 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.155843    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj4m4\" (UniqueName: \"kubernetes.io/projected/9d79ff63-6904-4b78-9837-8f9587976501-kube-api-access-gj4m4\") pod \"9d79ff63-6904-4b78-9837-8f9587976501\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") "
Jul 14 07:57:18.156059 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156000    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-serving-cert\") pod \"9d79ff63-6904-4b78-9837-8f9587976501\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") "
Jul 14 07:57:18.156176 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-service-ca\") pod \"9d79ff63-6904-4b78-9837-8f9587976501\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") "
Jul 14 07:57:18.156176 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156127    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-oauth-serving-cert\") pod \"9d79ff63-6904-4b78-9837-8f9587976501\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") "
Jul 14 07:57:18.156176 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156164    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-oauth-config\") pod \"9d79ff63-6904-4b78-9837-8f9587976501\" (UID: \"9d79ff63-6904-4b78-9837-8f9587976501\") "
Jul 14 07:57:18.156332 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156200    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9d79ff63-6904-4b78-9837-8f9587976501" (UID: "9d79ff63-6904-4b78-9837-8f9587976501"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:57:18.156332 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156253    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-console-config" (OuterVolumeSpecName: "console-config") pod "9d79ff63-6904-4b78-9837-8f9587976501" (UID: "9d79ff63-6904-4b78-9837-8f9587976501"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:57:18.156463 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156441    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-service-ca" (OuterVolumeSpecName: "service-ca") pod "9d79ff63-6904-4b78-9837-8f9587976501" (UID: "9d79ff63-6904-4b78-9837-8f9587976501"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:57:18.156518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156455    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-trusted-ca-bundle\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:57:18.156518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156481    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-console-config\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:57:18.156518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.156497    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9d79ff63-6904-4b78-9837-8f9587976501" (UID: "9d79ff63-6904-4b78-9837-8f9587976501"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 07:57:18.158264 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.158235    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9d79ff63-6904-4b78-9837-8f9587976501" (UID: "9d79ff63-6904-4b78-9837-8f9587976501"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:57:18.158377 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.158264    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9d79ff63-6904-4b78-9837-8f9587976501" (UID: "9d79ff63-6904-4b78-9837-8f9587976501"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 07:57:18.158377 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.158273    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d79ff63-6904-4b78-9837-8f9587976501-kube-api-access-gj4m4" (OuterVolumeSpecName: "kube-api-access-gj4m4") pod "9d79ff63-6904-4b78-9837-8f9587976501" (UID: "9d79ff63-6904-4b78-9837-8f9587976501"). InnerVolumeSpecName "kube-api-access-gj4m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:57:18.257087 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.257021    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-oauth-config\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:57:18.257087 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.257080    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj4m4\" (UniqueName: \"kubernetes.io/projected/9d79ff63-6904-4b78-9837-8f9587976501-kube-api-access-gj4m4\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:57:18.257087 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.257093    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d79ff63-6904-4b78-9837-8f9587976501-console-serving-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:57:18.257316 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.257105    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:57:18.257316 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.257148    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d79ff63-6904-4b78-9837-8f9587976501-oauth-serving-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:57:18.925332 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.925300    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6975d7bcfc-dp272"
Jul 14 07:57:18.925809 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.925295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6975d7bcfc-dp272" event={"ID":"9d79ff63-6904-4b78-9837-8f9587976501","Type":"ContainerDied","Data":"f61d0c745f7bb4c74f01e0e93255bc4d0ab4ca54a3c1fc99d84ed3e3ecca52c9"}
Jul 14 07:57:18.925809 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.925449    2579 scope.go:117] "RemoveContainer" containerID="72791257e7b33724a9e00b959c639ac2816974424d666ffa4e464f2269b9c366"
Jul 14 07:57:18.927474 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.927205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj" event={"ID":"9416fb35-8e8a-4cee-ac09-a27ad25c436b","Type":"ContainerStarted","Data":"82ff07c069c64c3e3534e9f97f8945a0f32872cd36bd3b7d37713dccad89a9a5"}
Jul 14 07:57:18.929246 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.929207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq" event={"ID":"a6c4a6c2-59ad-496b-8129-e245d44698c3","Type":"ContainerStarted","Data":"de264b32a12ca082778feba86435228e786bfc071b9cacb71f494f379d5d2527"}
Jul 14 07:57:18.949428 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.949379    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p7sqq" podStartSLOduration=1.708880822 podStartE2EDuration="24.949352954s" totalImagesPullingTime="23.240472132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:18.94698514 +0000 UTC m=+434.525991483" watchObservedRunningTime="2026-07-14 07:57:18.949352954 +0000 UTC m=+434.528359293"
Jul 14 07:57:18.964728 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.964696    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6975d7bcfc-dp272"]
Jul 14 07:57:18.971234 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.971198    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6975d7bcfc-dp272"]
Jul 14 07:57:18.988978 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:18.988938    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d79ff63-6904-4b78-9837-8f9587976501" path="/var/lib/kubelet/pods/9d79ff63-6904-4b78-9837-8f9587976501/volumes"
Jul 14 07:57:19.935920 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:19.935820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj" event={"ID":"9416fb35-8e8a-4cee-ac09-a27ad25c436b","Type":"ContainerStarted","Data":"154edcce8c8d3c92aaa10d96c031bceca16e218803438872da1ed0ccbf858c79"}
Jul 14 07:57:19.936390 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:19.936129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"
Jul 14 07:57:19.953245 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:19.953187    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj" podStartSLOduration=14.340088962 podStartE2EDuration="15.953160972s" totalImagesPullingTime="1.61307201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:19.951693723 +0000 UTC m=+435.530700063" watchObservedRunningTime="2026-07-14 07:57:19.953160972 +0000 UTC m=+435.532167311"
Jul 14 07:57:23.912080 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:23.912021    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:24.000329 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:24.000294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:24.064086 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:24.064055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:26.299367 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:26.299262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:26.399083 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:26.399017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:27.823414 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:27.823382    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:27.935977 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:27.935942    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:30.105974 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:30.105941    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:30.942524 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:30.942489    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmsj"
Jul 14 07:57:31.083835 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:31.083801    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:31.224982 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:31.224951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:33.677852 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:33.677821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:33.963684 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:33.963591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:35.264367 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:35.264336    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:35.329304 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:35.329266    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:38.259427 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:38.259391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:38.367185 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:38.367148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:38.432134 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:38.432097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:38.772981 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:38.772943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:38.874013 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:38.873980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:39.146699 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.146613    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:39.233526 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.233494    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6xh"]
Jul 14 07:57:39.233887 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.233868    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d79ff63-6904-4b78-9837-8f9587976501" containerName="console"
Jul 14 07:57:39.233887 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.233889    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d79ff63-6904-4b78-9837-8f9587976501" containerName="console"
Jul 14 07:57:39.234121 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.233982    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d79ff63-6904-4b78-9837-8f9587976501" containerName="console"
Jul 14 07:57:39.234121 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.234082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:39.260834 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.260795    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6xh"]
Jul 14 07:57:39.261246 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.260928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd6xh"
Jul 14 07:57:39.264086 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.264067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8fmc5\""
Jul 14 07:57:39.341269 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.341235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xztn9\" (UniqueName: \"kubernetes.io/projected/b37a4c10-9674-4c83-bb21-1fe2388f4798-kube-api-access-xztn9\") pod \"authorino-75d556bd77-nd6xh\" (UID: \"b37a4c10-9674-4c83-bb21-1fe2388f4798\") " pod="kuadrant-system/authorino-75d556bd77-nd6xh"
Jul 14 07:57:39.442222 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.442147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xztn9\" (UniqueName: \"kubernetes.io/projected/b37a4c10-9674-4c83-bb21-1fe2388f4798-kube-api-access-xztn9\") pod \"authorino-75d556bd77-nd6xh\" (UID: \"b37a4c10-9674-4c83-bb21-1fe2388f4798\") " pod="kuadrant-system/authorino-75d556bd77-nd6xh"
Jul 14 07:57:39.459233 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.459202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xztn9\" (UniqueName: \"kubernetes.io/projected/b37a4c10-9674-4c83-bb21-1fe2388f4798-kube-api-access-xztn9\") pod \"authorino-75d556bd77-nd6xh\" (UID: \"b37a4c10-9674-4c83-bb21-1fe2388f4798\") " pod="kuadrant-system/authorino-75d556bd77-nd6xh"
Jul 14 07:57:39.570461 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.570428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd6xh"
Jul 14 07:57:39.700436 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:39.700363    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6xh"]
Jul 14 07:57:39.703824 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:57:39.703796    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb37a4c10_9674_4c83_bb21_1fe2388f4798.slice/crio-04f74fa7e839408da6dc5e413af77f3479d482aa90ccbfdb06c6aced0359b190 WatchSource:0}: Error finding container 04f74fa7e839408da6dc5e413af77f3479d482aa90ccbfdb06c6aced0359b190: Status 404 returned error can't find the container with id 04f74fa7e839408da6dc5e413af77f3479d482aa90ccbfdb06c6aced0359b190
Jul 14 07:57:40.022073 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:40.022009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd6xh" event={"ID":"b37a4c10-9674-4c83-bb21-1fe2388f4798","Type":"ContainerStarted","Data":"04f74fa7e839408da6dc5e413af77f3479d482aa90ccbfdb06c6aced0359b190"}
Jul 14 07:57:43.036164 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:43.036128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd6xh" event={"ID":"b37a4c10-9674-4c83-bb21-1fe2388f4798","Type":"ContainerStarted","Data":"bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3"}
Jul 14 07:57:43.054107 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:43.054053    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nd6xh" podStartSLOduration=1.182249182 podStartE2EDuration="4.054020624s" totalImagesPullingTime="2.871771442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:43.052820502 +0000 UTC m=+458.631826840" watchObservedRunningTime="2026-07-14 07:57:43.054020624 +0000 UTC m=+458.633026962"
Jul 14 07:57:44.313122 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:44.313086    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:44.448886 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:44.448851    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:46.798300 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:46.798264    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:46.908751 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:46.908720    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:51.478962 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:51.478928    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:51.579161 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:51.579126    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:54.397096 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:54.397055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:54.534063 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:54.534009    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:57:54.908876 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:57:54.908841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:06.713455 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:06.713418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:06.938929 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:06.938888    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8qn2x"]
Jul 14 07:58:06.942617 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:06.942593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8qn2x"
Jul 14 07:58:06.956418 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:06.956392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8qn2x"]
Jul 14 07:58:06.977541 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:06.977511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrfq\" (UniqueName: \"kubernetes.io/projected/56a791d5-c3a7-498b-be0d-b8fb3d513390-kube-api-access-pdrfq\") pod \"authorino-5d4b67c446-8qn2x\" (UID: \"56a791d5-c3a7-498b-be0d-b8fb3d513390\") " pod="kuadrant-system/authorino-5d4b67c446-8qn2x"
Jul 14 07:58:06.997454 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:06.997422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:07.078704 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.078670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrfq\" (UniqueName: \"kubernetes.io/projected/56a791d5-c3a7-498b-be0d-b8fb3d513390-kube-api-access-pdrfq\") pod \"authorino-5d4b67c446-8qn2x\" (UID: \"56a791d5-c3a7-498b-be0d-b8fb3d513390\") " pod="kuadrant-system/authorino-5d4b67c446-8qn2x"
Jul 14 07:58:07.089725 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.089695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrfq\" (UniqueName: \"kubernetes.io/projected/56a791d5-c3a7-498b-be0d-b8fb3d513390-kube-api-access-pdrfq\") pod \"authorino-5d4b67c446-8qn2x\" (UID: \"56a791d5-c3a7-498b-be0d-b8fb3d513390\") " pod="kuadrant-system/authorino-5d4b67c446-8qn2x"
Jul 14 07:58:07.177844 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.177807    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8qn2x"]
Jul 14 07:58:07.178079 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.178067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8qn2x"
Jul 14 07:58:07.211189 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.209749    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-555ccc9dd8-kptbj"]
Jul 14 07:58:07.213226 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.213200    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-555ccc9dd8-kptbj"
Jul 14 07:58:07.221841 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.221807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-555ccc9dd8-kptbj"]
Jul 14 07:58:07.280599 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.280568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66s6n\" (UniqueName: \"kubernetes.io/projected/1d0cf118-25d4-4ef9-a896-a758cbad5c92-kube-api-access-66s6n\") pod \"authorino-555ccc9dd8-kptbj\" (UID: \"1d0cf118-25d4-4ef9-a896-a758cbad5c92\") " pod="kuadrant-system/authorino-555ccc9dd8-kptbj"
Jul 14 07:58:07.327251 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.327228    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8qn2x"]
Jul 14 07:58:07.330520 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:58:07.330487    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56a791d5_c3a7_498b_be0d_b8fb3d513390.slice/crio-1f8c4bc38645e81ad2aa88398e21660e10faab2a62fd689905213e3725591c82 WatchSource:0}: Error finding container 1f8c4bc38645e81ad2aa88398e21660e10faab2a62fd689905213e3725591c82: Status 404 returned error can't find the container with id 1f8c4bc38645e81ad2aa88398e21660e10faab2a62fd689905213e3725591c82
Jul 14 07:58:07.381531 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.381502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66s6n\" (UniqueName: \"kubernetes.io/projected/1d0cf118-25d4-4ef9-a896-a758cbad5c92-kube-api-access-66s6n\") pod \"authorino-555ccc9dd8-kptbj\" (UID: \"1d0cf118-25d4-4ef9-a896-a758cbad5c92\") " pod="kuadrant-system/authorino-555ccc9dd8-kptbj"
Jul 14 07:58:07.390246 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.390216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66s6n\" (UniqueName: \"kubernetes.io/projected/1d0cf118-25d4-4ef9-a896-a758cbad5c92-kube-api-access-66s6n\") pod \"authorino-555ccc9dd8-kptbj\" (UID: \"1d0cf118-25d4-4ef9-a896-a758cbad5c92\") " pod="kuadrant-system/authorino-555ccc9dd8-kptbj"
Jul 14 07:58:07.402501 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.402466    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-555ccc9dd8-kptbj"]
Jul 14 07:58:07.402733 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.402722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-555ccc9dd8-kptbj"
Jul 14 07:58:07.432511 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.432481    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5755b5768-fpnvp"]
Jul 14 07:58:07.435560 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.435539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 07:58:07.438205 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.438182    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 14 07:58:07.444682 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.444435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5755b5768-fpnvp"]
Jul 14 07:58:07.483004 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.482969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmdk2\" (UniqueName: \"kubernetes.io/projected/779c0268-0408-4d01-9fc9-30b0c0f092b4-kube-api-access-xmdk2\") pod \"authorino-5755b5768-fpnvp\" (UID: \"779c0268-0408-4d01-9fc9-30b0c0f092b4\") " pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 07:58:07.483193 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.483062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/779c0268-0408-4d01-9fc9-30b0c0f092b4-tls-cert\") pod \"authorino-5755b5768-fpnvp\" (UID: \"779c0268-0408-4d01-9fc9-30b0c0f092b4\") " pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 07:58:07.539847 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.539821    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-555ccc9dd8-kptbj"]
Jul 14 07:58:07.542056 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:58:07.542017    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d0cf118_25d4_4ef9_a896_a758cbad5c92.slice/crio-09edc4eed515df91a0377e0673d314ed798efe938e6801bdf45b73b0af6fdda6 WatchSource:0}: Error finding container 09edc4eed515df91a0377e0673d314ed798efe938e6801bdf45b73b0af6fdda6: Status 404 returned error can't find the container with id 09edc4eed515df91a0377e0673d314ed798efe938e6801bdf45b73b0af6fdda6
Jul 14 07:58:07.584186 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.584153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdk2\" (UniqueName: \"kubernetes.io/projected/779c0268-0408-4d01-9fc9-30b0c0f092b4-kube-api-access-xmdk2\") pod \"authorino-5755b5768-fpnvp\" (UID: \"779c0268-0408-4d01-9fc9-30b0c0f092b4\") " pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 07:58:07.584375 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.584216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/779c0268-0408-4d01-9fc9-30b0c0f092b4-tls-cert\") pod \"authorino-5755b5768-fpnvp\" (UID: \"779c0268-0408-4d01-9fc9-30b0c0f092b4\") " pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 07:58:07.586663 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.586643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/779c0268-0408-4d01-9fc9-30b0c0f092b4-tls-cert\") pod \"authorino-5755b5768-fpnvp\" (UID: \"779c0268-0408-4d01-9fc9-30b0c0f092b4\") " pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 07:58:07.595325 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.595301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmdk2\" (UniqueName: \"kubernetes.io/projected/779c0268-0408-4d01-9fc9-30b0c0f092b4-kube-api-access-xmdk2\") pod \"authorino-5755b5768-fpnvp\" (UID: \"779c0268-0408-4d01-9fc9-30b0c0f092b4\") " pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 07:58:07.747589 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.747557    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 07:58:07.888913 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:07.888885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5755b5768-fpnvp"]
Jul 14 07:58:07.905242 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:58:07.905208    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod779c0268_0408_4d01_9fc9_30b0c0f092b4.slice/crio-0d98a2761c0f2d0644a844c30260874686279b7e5b7ae2a3beaf903cb3400f92 WatchSource:0}: Error finding container 0d98a2761c0f2d0644a844c30260874686279b7e5b7ae2a3beaf903cb3400f92: Status 404 returned error can't find the container with id 0d98a2761c0f2d0644a844c30260874686279b7e5b7ae2a3beaf903cb3400f92
Jul 14 07:58:08.149155 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.149051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5755b5768-fpnvp" event={"ID":"779c0268-0408-4d01-9fc9-30b0c0f092b4","Type":"ContainerStarted","Data":"0d98a2761c0f2d0644a844c30260874686279b7e5b7ae2a3beaf903cb3400f92"}
Jul 14 07:58:08.150464 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.150427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-555ccc9dd8-kptbj" event={"ID":"1d0cf118-25d4-4ef9-a896-a758cbad5c92","Type":"ContainerStarted","Data":"61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38"}
Jul 14 07:58:08.150620 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.150475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-555ccc9dd8-kptbj" event={"ID":"1d0cf118-25d4-4ef9-a896-a758cbad5c92","Type":"ContainerStarted","Data":"09edc4eed515df91a0377e0673d314ed798efe938e6801bdf45b73b0af6fdda6"}
Jul 14 07:58:08.150620 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.150503    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-555ccc9dd8-kptbj" podUID="1d0cf118-25d4-4ef9-a896-a758cbad5c92" containerName="authorino" containerID="cri-o://61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38" gracePeriod=30
Jul 14 07:58:08.152113 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.152089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8qn2x" event={"ID":"56a791d5-c3a7-498b-be0d-b8fb3d513390","Type":"ContainerStarted","Data":"b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce"}
Jul 14 07:58:08.152244 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.152124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8qn2x" event={"ID":"56a791d5-c3a7-498b-be0d-b8fb3d513390","Type":"ContainerStarted","Data":"1f8c4bc38645e81ad2aa88398e21660e10faab2a62fd689905213e3725591c82"}
Jul 14 07:58:08.152244 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.152121    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8qn2x" podUID="56a791d5-c3a7-498b-be0d-b8fb3d513390" containerName="authorino" containerID="cri-o://b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce" gracePeriod=30
Jul 14 07:58:08.177029 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.176981    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-555ccc9dd8-kptbj" podStartSLOduration=0.864079973 podStartE2EDuration="1.176963109s" totalImagesPullingTime="312.883136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:08.175687473 +0000 UTC m=+483.754693812" watchObservedRunningTime="2026-07-14 07:58:08.176963109 +0000 UTC m=+483.755969448"
Jul 14 07:58:08.192493 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.192434    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8qn2x" podStartSLOduration=1.8592671520000001 podStartE2EDuration="2.192419806s" totalImagesPullingTime="333.152654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:08.190793703 +0000 UTC m=+483.769800043" watchObservedRunningTime="2026-07-14 07:58:08.192419806 +0000 UTC m=+483.771426145"
Jul 14 07:58:08.424166 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.424139    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-555ccc9dd8-kptbj"
Jul 14 07:58:08.432273 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.432241    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8qn2x"
Jul 14 07:58:08.492576 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.492535    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66s6n\" (UniqueName: \"kubernetes.io/projected/1d0cf118-25d4-4ef9-a896-a758cbad5c92-kube-api-access-66s6n\") pod \"1d0cf118-25d4-4ef9-a896-a758cbad5c92\" (UID: \"1d0cf118-25d4-4ef9-a896-a758cbad5c92\") "
Jul 14 07:58:08.492576 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.492585    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdrfq\" (UniqueName: \"kubernetes.io/projected/56a791d5-c3a7-498b-be0d-b8fb3d513390-kube-api-access-pdrfq\") pod \"56a791d5-c3a7-498b-be0d-b8fb3d513390\" (UID: \"56a791d5-c3a7-498b-be0d-b8fb3d513390\") "
Jul 14 07:58:08.494756 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.494734    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a791d5-c3a7-498b-be0d-b8fb3d513390-kube-api-access-pdrfq" (OuterVolumeSpecName: "kube-api-access-pdrfq") pod "56a791d5-c3a7-498b-be0d-b8fb3d513390" (UID: "56a791d5-c3a7-498b-be0d-b8fb3d513390"). InnerVolumeSpecName "kube-api-access-pdrfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:58:08.494824 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.494768    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d0cf118-25d4-4ef9-a896-a758cbad5c92-kube-api-access-66s6n" (OuterVolumeSpecName: "kube-api-access-66s6n") pod "1d0cf118-25d4-4ef9-a896-a758cbad5c92" (UID: "1d0cf118-25d4-4ef9-a896-a758cbad5c92"). InnerVolumeSpecName "kube-api-access-66s6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:58:08.594154 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.594101    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66s6n\" (UniqueName: \"kubernetes.io/projected/1d0cf118-25d4-4ef9-a896-a758cbad5c92-kube-api-access-66s6n\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:58:08.594154 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:08.594146    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdrfq\" (UniqueName: \"kubernetes.io/projected/56a791d5-c3a7-498b-be0d-b8fb3d513390-kube-api-access-pdrfq\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:58:09.158006 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.157971    2579 generic.go:356] "Generic (PLEG): container finished" podID="1d0cf118-25d4-4ef9-a896-a758cbad5c92" containerID="61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38" exitCode=0
Jul 14 07:58:09.158006 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.158010    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-555ccc9dd8-kptbj"
Jul 14 07:58:09.158501 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.158065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-555ccc9dd8-kptbj" event={"ID":"1d0cf118-25d4-4ef9-a896-a758cbad5c92","Type":"ContainerDied","Data":"61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38"}
Jul 14 07:58:09.158501 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.158108    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-555ccc9dd8-kptbj" event={"ID":"1d0cf118-25d4-4ef9-a896-a758cbad5c92","Type":"ContainerDied","Data":"09edc4eed515df91a0377e0673d314ed798efe938e6801bdf45b73b0af6fdda6"}
Jul 14 07:58:09.158501 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.158129    2579 scope.go:117] "RemoveContainer" containerID="61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38"
Jul 14 07:58:09.159360 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.159335    2579 generic.go:356] "Generic (PLEG): container finished" podID="56a791d5-c3a7-498b-be0d-b8fb3d513390" containerID="b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce" exitCode=0
Jul 14 07:58:09.159489 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.159366    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8qn2x"
Jul 14 07:58:09.159489 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.159386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8qn2x" event={"ID":"56a791d5-c3a7-498b-be0d-b8fb3d513390","Type":"ContainerDied","Data":"b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce"}
Jul 14 07:58:09.159489 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.159425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8qn2x" event={"ID":"56a791d5-c3a7-498b-be0d-b8fb3d513390","Type":"ContainerDied","Data":"1f8c4bc38645e81ad2aa88398e21660e10faab2a62fd689905213e3725591c82"}
Jul 14 07:58:09.167798 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.167773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5755b5768-fpnvp" event={"ID":"779c0268-0408-4d01-9fc9-30b0c0f092b4","Type":"ContainerStarted","Data":"f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32"}
Jul 14 07:58:09.171157 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.171136    2579 scope.go:117] "RemoveContainer" containerID="61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38"
Jul 14 07:58:09.171446 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:58:09.171415    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38\": container with ID starting with 61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38 not found: ID does not exist" containerID="61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38"
Jul 14 07:58:09.171526 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.171460    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38"} err="failed to get container status \"61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38\": rpc error: code = NotFound desc = could not find container \"61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38\": container with ID starting with 61bfb036615ccb8577ecb6412e1c2edc5e0544a4fa332de57f59ffc2e2958f38 not found: ID does not exist"
Jul 14 07:58:09.171526 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.171481    2579 scope.go:117] "RemoveContainer" containerID="b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce"
Jul 14 07:58:09.178861 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.178843    2579 scope.go:117] "RemoveContainer" containerID="b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce"
Jul 14 07:58:09.179220 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:58:09.179190    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce\": container with ID starting with b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce not found: ID does not exist" containerID="b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce"
Jul 14 07:58:09.179283 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.179219    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce"} err="failed to get container status \"b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce\": rpc error: code = NotFound desc = could not find container \"b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce\": container with ID starting with b0e2565f336d2c0cc8f1660e0a2d911f7d84da075dc0629d91d137163b4083ce not found: ID does not exist"
Jul 14 07:58:09.188453 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.188431    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-555ccc9dd8-kptbj"]
Jul 14 07:58:09.194519 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.194498    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-555ccc9dd8-kptbj"]
Jul 14 07:58:09.209245 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.209217    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8qn2x"]
Jul 14 07:58:09.216346 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.216322    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8qn2x"]
Jul 14 07:58:09.233649 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.233599    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5755b5768-fpnvp" podStartSLOduration=1.917007702 podStartE2EDuration="2.233583314s" totalImagesPullingTime="316.575612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:58:09.230419526 +0000 UTC m=+484.809425843" watchObservedRunningTime="2026-07-14 07:58:09.233583314 +0000 UTC m=+484.812589653"
Jul 14 07:58:09.276223 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.276127    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6xh"]
Jul 14 07:58:09.276373 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.276350    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nd6xh" podUID="b37a4c10-9674-4c83-bb21-1fe2388f4798" containerName="authorino" containerID="cri-o://bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3" gracePeriod=30
Jul 14 07:58:09.523728 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.523704    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd6xh"
Jul 14 07:58:09.604926 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.604828    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xztn9\" (UniqueName: \"kubernetes.io/projected/b37a4c10-9674-4c83-bb21-1fe2388f4798-kube-api-access-xztn9\") pod \"b37a4c10-9674-4c83-bb21-1fe2388f4798\" (UID: \"b37a4c10-9674-4c83-bb21-1fe2388f4798\") "
Jul 14 07:58:09.606904 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.606882    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b37a4c10-9674-4c83-bb21-1fe2388f4798-kube-api-access-xztn9" (OuterVolumeSpecName: "kube-api-access-xztn9") pod "b37a4c10-9674-4c83-bb21-1fe2388f4798" (UID: "b37a4c10-9674-4c83-bb21-1fe2388f4798"). InnerVolumeSpecName "kube-api-access-xztn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 07:58:09.705704 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:09.705667    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xztn9\" (UniqueName: \"kubernetes.io/projected/b37a4c10-9674-4c83-bb21-1fe2388f4798-kube-api-access-xztn9\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 07:58:10.173933 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.173901    2579 generic.go:356] "Generic (PLEG): container finished" podID="b37a4c10-9674-4c83-bb21-1fe2388f4798" containerID="bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3" exitCode=0
Jul 14 07:58:10.174431 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.173947    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd6xh"
Jul 14 07:58:10.174431 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.173980    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd6xh" event={"ID":"b37a4c10-9674-4c83-bb21-1fe2388f4798","Type":"ContainerDied","Data":"bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3"}
Jul 14 07:58:10.174431 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.174023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd6xh" event={"ID":"b37a4c10-9674-4c83-bb21-1fe2388f4798","Type":"ContainerDied","Data":"04f74fa7e839408da6dc5e413af77f3479d482aa90ccbfdb06c6aced0359b190"}
Jul 14 07:58:10.174431 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.174073    2579 scope.go:117] "RemoveContainer" containerID="bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3"
Jul 14 07:58:10.182276 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.182187    2579 scope.go:117] "RemoveContainer" containerID="bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3"
Jul 14 07:58:10.182473 ip-10-0-131-251 kubenswrapper[2579]: E0714 07:58:10.182454    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3\": container with ID starting with bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3 not found: ID does not exist" containerID="bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3"
Jul 14 07:58:10.182534 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.182483    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3"} err="failed to get container status \"bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3\": rpc error: code = NotFound desc = could not find container \"bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3\": container with ID starting with bfb705623f5e75844ba3783f297fd5b9552d7b3293d347123be3ee8d413ebaf3 not found: ID does not exist"
Jul 14 07:58:10.235695 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.235665    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6xh"]
Jul 14 07:58:10.246830 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.246803    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6xh"]
Jul 14 07:58:10.985193 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.985164    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d0cf118-25d4-4ef9-a896-a758cbad5c92" path="/var/lib/kubelet/pods/1d0cf118-25d4-4ef9-a896-a758cbad5c92/volumes"
Jul 14 07:58:10.985516 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.985503    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a791d5-c3a7-498b-be0d-b8fb3d513390" path="/var/lib/kubelet/pods/56a791d5-c3a7-498b-be0d-b8fb3d513390/volumes"
Jul 14 07:58:10.985799 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:10.985787    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b37a4c10-9674-4c83-bb21-1fe2388f4798" path="/var/lib/kubelet/pods/b37a4c10-9674-4c83-bb21-1fe2388f4798/volumes"
Jul 14 07:58:14.010460 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:14.010423    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:14.149057 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:14.149001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:14.267804 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:14.267722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:14.337279 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:14.337249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:17.517706 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:17.517667    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:17.613637 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:17.613598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:50.135681 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:50.135647    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:50.247883 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:50.247849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:50.771672 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:50.771640    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:51.057094 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:51.056986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:51.581960 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:51.581925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:51.679355 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:51.679320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:58.003983 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:58.003901    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:58:58.061983 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:58:58.061948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:01.698565 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:01.698526    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:01.786838 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:01.786808    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:13.570851 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:13.570819    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:14.593050 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:14.593006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:24.719702 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.719669    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"]
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.719980    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a791d5-c3a7-498b-be0d-b8fb3d513390" containerName="authorino"
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.719989    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a791d5-c3a7-498b-be0d-b8fb3d513390" containerName="authorino"
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.720000    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0cf118-25d4-4ef9-a896-a758cbad5c92" containerName="authorino"
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.720006    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0cf118-25d4-4ef9-a896-a758cbad5c92" containerName="authorino"
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.720014    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37a4c10-9674-4c83-bb21-1fe2388f4798" containerName="authorino"
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.720019    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37a4c10-9674-4c83-bb21-1fe2388f4798" containerName="authorino"
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.720104    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b37a4c10-9674-4c83-bb21-1fe2388f4798" containerName="authorino"
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.720112    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d0cf118-25d4-4ef9-a896-a758cbad5c92" containerName="authorino"
Jul 14 07:59:24.720194 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.720123    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a791d5-c3a7-498b-be0d-b8fb3d513390" containerName="authorino"
Jul 14 07:59:24.724536 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.724518    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.728592 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.728570    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 07:59:24.729381 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.729364    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 07:59:24.729483 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.729403    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpldq\""
Jul 14 07:59:24.729706 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.729691    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 14 07:59:24.763253 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.763211    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"]
Jul 14 07:59:24.835554 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.835522    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:24.855760 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.855727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07763d46-c99c-4049-90a0-42407dd01d64-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.855919 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.855843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.855919 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.855877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvw6\" (UniqueName: \"kubernetes.io/projected/07763d46-c99c-4049-90a0-42407dd01d64-kube-api-access-gvvw6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.855919 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.855900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.855919 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.855918    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.856086 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.855941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957031 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.956995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957229 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.957064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvw6\" (UniqueName: \"kubernetes.io/projected/07763d46-c99c-4049-90a0-42407dd01d64-kube-api-access-gvvw6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957229 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.957093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957229 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.957111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957229 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.957134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957229 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.957177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07763d46-c99c-4049-90a0-42407dd01d64-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.957483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957518 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.957507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.957599 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.957553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.959501 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.959480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07763d46-c99c-4049-90a0-42407dd01d64-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.959651 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.959632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07763d46-c99c-4049-90a0-42407dd01d64-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:24.967130 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:24.967096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvw6\" (UniqueName: \"kubernetes.io/projected/07763d46-c99c-4049-90a0-42407dd01d64-kube-api-access-gvvw6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k8k5s\" (UID: \"07763d46-c99c-4049-90a0-42407dd01d64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:25.034938 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:25.034837    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:25.171590 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:25.171545    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"]
Jul 14 07:59:25.174524 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:59:25.174490    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07763d46_c99c_4049_90a0_42407dd01d64.slice/crio-826f494836841c744524ad5ae6d043aa237e4369e644d3760550eb9f6869c118 WatchSource:0}: Error finding container 826f494836841c744524ad5ae6d043aa237e4369e644d3760550eb9f6869c118: Status 404 returned error can't find the container with id 826f494836841c744524ad5ae6d043aa237e4369e644d3760550eb9f6869c118
Jul 14 07:59:25.503956 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:25.503915    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s" event={"ID":"07763d46-c99c-4049-90a0-42407dd01d64","Type":"ContainerStarted","Data":"826f494836841c744524ad5ae6d043aa237e4369e644d3760550eb9f6869c118"}
Jul 14 07:59:26.509318 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:26.509274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s" event={"ID":"07763d46-c99c-4049-90a0-42407dd01d64","Type":"ContainerStarted","Data":"5941a806cea0dc117288d59e619a8f4e2bcc30e66eb01a83b4d5b3702b4e8e4f"}
Jul 14 07:59:26.528924 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:26.528809    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s" podStartSLOduration=1.425851123 podStartE2EDuration="2.528793037s" totalImagesPullingTime="1.102941914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:59:26.526803142 +0000 UTC m=+562.105809559" watchObservedRunningTime="2026-07-14 07:59:26.528793037 +0000 UTC m=+562.107799375"
Jul 14 07:59:35.035172 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:35.035135    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:35.035582 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:35.035195    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:35.047887 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:35.047863    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:35.558635 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:35.558603    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k8k5s"
Jul 14 07:59:40.613561 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:40.613532    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:41.560195 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:41.560160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:46.606069 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:46.606020    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:56.273609 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.273576    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"]
Jul 14 07:59:56.279669 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.279646    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.282179 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.282154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 14 07:59:56.286159 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.286129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"]
Jul 14 07:59:56.299094 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.299018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 07:59:56.329916 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.329877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvqtf\" (UniqueName: \"kubernetes.io/projected/f51ea579-305a-4544-90d6-5a1c0b63482c-kube-api-access-nvqtf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.329916 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.329915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.330195 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.329945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.330195 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.330080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.330195 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.330139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51ea579-305a-4544-90d6-5a1c0b63482c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.330195 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.330179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.430910 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.430867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51ea579-305a-4544-90d6-5a1c0b63482c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.430910 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.430917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.431283 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.430979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvqtf\" (UniqueName: \"kubernetes.io/projected/f51ea579-305a-4544-90d6-5a1c0b63482c-kube-api-access-nvqtf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.431283 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.431024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.431283 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.431168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.431283 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.431235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.431481 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.431411    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.431481 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.431437    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.431595 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.431572    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.433373 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.433342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51ea579-305a-4544-90d6-5a1c0b63482c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.433475 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.433350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51ea579-305a-4544-90d6-5a1c0b63482c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.439287 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.439266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvqtf\" (UniqueName: \"kubernetes.io/projected/f51ea579-305a-4544-90d6-5a1c0b63482c-kube-api-access-nvqtf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9tkl\" (UID: \"f51ea579-305a-4544-90d6-5a1c0b63482c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.590347 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.590256    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 07:59:56.725475 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:56.725449    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"]
Jul 14 07:59:56.727961 ip-10-0-131-251 kubenswrapper[2579]: W0714 07:59:56.727936    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51ea579_305a_4544_90d6_5a1c0b63482c.slice/crio-005e3b0e73c31149e24c4cef37ba369fcecda914895edfdf02a6153ed7da9857 WatchSource:0}: Error finding container 005e3b0e73c31149e24c4cef37ba369fcecda914895edfdf02a6153ed7da9857: Status 404 returned error can't find the container with id 005e3b0e73c31149e24c4cef37ba369fcecda914895edfdf02a6153ed7da9857
Jul 14 07:59:57.645059 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:57.645002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl" event={"ID":"f51ea579-305a-4544-90d6-5a1c0b63482c","Type":"ContainerStarted","Data":"1587d8467b55aee305385956f2fd28b179cd675822fdd9dc3be518883d98d33b"}
Jul 14 07:59:57.645562 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:57.645081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl" event={"ID":"f51ea579-305a-4544-90d6-5a1c0b63482c","Type":"ContainerStarted","Data":"005e3b0e73c31149e24c4cef37ba369fcecda914895edfdf02a6153ed7da9857"}
Jul 14 07:59:57.662941 ip-10-0-131-251 kubenswrapper[2579]: I0714 07:59:57.662890    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl" podStartSLOduration=1.482755597 podStartE2EDuration="1.662873351s" totalImagesPullingTime="180.117754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:59:57.662016731 +0000 UTC m=+593.241023105" watchObservedRunningTime="2026-07-14 07:59:57.662873351 +0000 UTC m=+593.241879690"
Jul 14 08:00:00.140411 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:00.140366    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92"]
Jul 14 08:00:00.143866 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:00.143842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92"
Jul 14 08:00:00.146575 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:00.146553    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:00:00.151993 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:00.151755    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92"]
Jul 14 08:00:00.156047 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:00.156018    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92"
Jul 14 08:00:00.288692 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:00.288657    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92"]
Jul 14 08:00:00.291831 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:00:00.291802    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47793f1_bc3f_4820_bdc5_100262a81c83.slice/crio-0a11685aa9ac2ac8fa60d0a2a111317504c6525ecf68af9c5761b02ae28618ec WatchSource:0}: Error finding container 0a11685aa9ac2ac8fa60d0a2a111317504c6525ecf68af9c5761b02ae28618ec: Status 404 returned error can't find the container with id 0a11685aa9ac2ac8fa60d0a2a111317504c6525ecf68af9c5761b02ae28618ec
Jul 14 08:00:00.663628 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:00.663584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92" event={"ID":"c47793f1-bc3f-4820-bdc5-100262a81c83","Type":"ContainerStarted","Data":"0a11685aa9ac2ac8fa60d0a2a111317504c6525ecf68af9c5761b02ae28618ec"}
Jul 14 08:00:04.172282 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.172246    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"]
Jul 14 08:00:04.177771 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.177750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.180380 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.180358    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 14 08:00:04.185959 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.185936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"]
Jul 14 08:00:04.300121 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.300083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.300302 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.300153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.300302 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.300188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15967a38-6372-4fe2-92d7-21833aaf9e7b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.300302 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.300220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.300302 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.300244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq69l\" (UniqueName: \"kubernetes.io/projected/15967a38-6372-4fe2-92d7-21833aaf9e7b-kube-api-access-nq69l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.300302 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.300274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401143 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15967a38-6372-4fe2-92d7-21833aaf9e7b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401340 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401340 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq69l\" (UniqueName: \"kubernetes.io/projected/15967a38-6372-4fe2-92d7-21833aaf9e7b-kube-api-access-nq69l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401340 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401340 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401565 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401800 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401917 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.401979 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.401957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.403806 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.403783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15967a38-6372-4fe2-92d7-21833aaf9e7b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.403980 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.403961    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15967a38-6372-4fe2-92d7-21833aaf9e7b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.410747 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.410722    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq69l\" (UniqueName: \"kubernetes.io/projected/15967a38-6372-4fe2-92d7-21833aaf9e7b-kube-api-access-nq69l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22\" (UID: \"15967a38-6372-4fe2-92d7-21833aaf9e7b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.419505 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.419457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:00:04.487224 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.487186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:04.646246 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.646212    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"]
Jul 14 08:00:04.649782 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:00:04.649747    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15967a38_6372_4fe2_92d7_21833aaf9e7b.slice/crio-928ffbd462b6e0c0247eb7c162299feee01545014319ca814565e42dbe2d2a5b WatchSource:0}: Error finding container 928ffbd462b6e0c0247eb7c162299feee01545014319ca814565e42dbe2d2a5b: Status 404 returned error can't find the container with id 928ffbd462b6e0c0247eb7c162299feee01545014319ca814565e42dbe2d2a5b
Jul 14 08:00:04.689089 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.689049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22" event={"ID":"15967a38-6372-4fe2-92d7-21833aaf9e7b","Type":"ContainerStarted","Data":"928ffbd462b6e0c0247eb7c162299feee01545014319ca814565e42dbe2d2a5b"}
Jul 14 08:00:04.847698 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.847621    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:00:04.847860 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:04.847744    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:00:06.591251 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:06.591217    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 08:00:06.591714 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:06.591294    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 08:00:06.603864 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:06.603837    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 08:00:06.699196 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:06.699165    2579 generic.go:356] "Generic (PLEG): container finished" podID="c47793f1-bc3f-4820-bdc5-100262a81c83" containerID="7da317c61f2aa88ea80698a2beb0ce9fc846e0ae8734751ce39e45ad2bd0c25d" exitCode=0
Jul 14 08:00:06.699379 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:06.699260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92" event={"ID":"c47793f1-bc3f-4820-bdc5-100262a81c83","Type":"ContainerDied","Data":"7da317c61f2aa88ea80698a2beb0ce9fc846e0ae8734751ce39e45ad2bd0c25d"}
Jul 14 08:00:06.710821 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:06.710796    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9tkl"
Jul 14 08:00:07.837155 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:07.837125    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92"
Jul 14 08:00:08.712019 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:08.711978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92" event={"ID":"c47793f1-bc3f-4820-bdc5-100262a81c83","Type":"ContainerDied","Data":"0a11685aa9ac2ac8fa60d0a2a111317504c6525ecf68af9c5761b02ae28618ec"}
Jul 14 08:00:08.713553 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:08.712031    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a11685aa9ac2ac8fa60d0a2a111317504c6525ecf68af9c5761b02ae28618ec"
Jul 14 08:00:08.713553 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:08.711997    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733600-pvl92"
Jul 14 08:00:27.799496 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:27.799458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22" event={"ID":"15967a38-6372-4fe2-92d7-21833aaf9e7b","Type":"ContainerStarted","Data":"58c2e942d63da2d88ed664e5976a5e7b7e884e13eef5a8d0e0fcbc99b5e3957f"}
Jul 14 08:00:27.820145 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:27.820088    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22" podStartSLOduration=1.62738833 podStartE2EDuration="23.820070681s" totalImagesPullingTime="22.192682351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:00:27.818354404 +0000 UTC m=+623.397360744" watchObservedRunningTime="2026-07-14 08:00:27.820070681 +0000 UTC m=+623.399077021"
Jul 14 08:00:31.245686 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:31.245650    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:00:34.487568 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:34.487529    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:34.487568 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:34.487579    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:34.499979 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:34.499950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:00:34.840780 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:00:34.840690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22"
Jul 14 08:01:00.919116 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:00.919074    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:01:01.005342 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:01.005291    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:01:12.823488 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:12.823452    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:01:12.904349 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:12.904303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:01:13.958443 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:13.958402    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:01:14.055600 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.055561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:01:14.534161 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.534118    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5755b5768-fpnvp"]
Jul 14 08:01:14.534393 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.534307    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5755b5768-fpnvp" podUID="779c0268-0408-4d01-9fc9-30b0c0f092b4" containerName="authorino" containerID="cri-o://f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32" gracePeriod=30
Jul 14 08:01:14.788075 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.787986    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 08:01:14.819834 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.819798    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmdk2\" (UniqueName: \"kubernetes.io/projected/779c0268-0408-4d01-9fc9-30b0c0f092b4-kube-api-access-xmdk2\") pod \"779c0268-0408-4d01-9fc9-30b0c0f092b4\" (UID: \"779c0268-0408-4d01-9fc9-30b0c0f092b4\") "
Jul 14 08:01:14.820070 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.819866    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/779c0268-0408-4d01-9fc9-30b0c0f092b4-tls-cert\") pod \"779c0268-0408-4d01-9fc9-30b0c0f092b4\" (UID: \"779c0268-0408-4d01-9fc9-30b0c0f092b4\") "
Jul 14 08:01:14.821950 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.821920    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/779c0268-0408-4d01-9fc9-30b0c0f092b4-kube-api-access-xmdk2" (OuterVolumeSpecName: "kube-api-access-xmdk2") pod "779c0268-0408-4d01-9fc9-30b0c0f092b4" (UID: "779c0268-0408-4d01-9fc9-30b0c0f092b4"). InnerVolumeSpecName "kube-api-access-xmdk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:01:14.829908 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.829873    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/779c0268-0408-4d01-9fc9-30b0c0f092b4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "779c0268-0408-4d01-9fc9-30b0c0f092b4" (UID: "779c0268-0408-4d01-9fc9-30b0c0f092b4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:01:14.920490 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.920454    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmdk2\" (UniqueName: \"kubernetes.io/projected/779c0268-0408-4d01-9fc9-30b0c0f092b4-kube-api-access-xmdk2\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:01:14.920490 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:14.920483    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/779c0268-0408-4d01-9fc9-30b0c0f092b4-tls-cert\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:01:15.007787 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.007758    2579 generic.go:356] "Generic (PLEG): container finished" podID="779c0268-0408-4d01-9fc9-30b0c0f092b4" containerID="f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32" exitCode=0
Jul 14 08:01:15.008201 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.007805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5755b5768-fpnvp" event={"ID":"779c0268-0408-4d01-9fc9-30b0c0f092b4","Type":"ContainerDied","Data":"f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32"}
Jul 14 08:01:15.008201 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.007813    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5755b5768-fpnvp"
Jul 14 08:01:15.008201 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.007840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5755b5768-fpnvp" event={"ID":"779c0268-0408-4d01-9fc9-30b0c0f092b4","Type":"ContainerDied","Data":"0d98a2761c0f2d0644a844c30260874686279b7e5b7ae2a3beaf903cb3400f92"}
Jul 14 08:01:15.008201 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.007857    2579 scope.go:117] "RemoveContainer" containerID="f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32"
Jul 14 08:01:15.016234 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.016175    2579 scope.go:117] "RemoveContainer" containerID="f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32"
Jul 14 08:01:15.016464 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:01:15.016442    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32\": container with ID starting with f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32 not found: ID does not exist" containerID="f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32"
Jul 14 08:01:15.016521 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.016473    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32"} err="failed to get container status \"f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32\": rpc error: code = NotFound desc = could not find container \"f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32\": container with ID starting with f3b9e7d6dc4b80f21dcc451ec68b286260968d61f167b1b6f6509d6d27af1d32 not found: ID does not exist"
Jul 14 08:01:15.028112 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.028088    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5755b5768-fpnvp"]
Jul 14 08:01:15.031979 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.031955    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5755b5768-fpnvp"]
Jul 14 08:01:15.662550 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:15.662512    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:01:16.984464 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:01:16.984432    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="779c0268-0408-4d01-9fc9-30b0c0f092b4" path="/var/lib/kubelet/pods/779c0268-0408-4d01-9fc9-30b0c0f092b4/volumes"
Jul 14 08:02:24.324111 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:02:24.324075    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:02:25.581168 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:02:25.581125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:11.757498 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:11.757459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:11.898822 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:11.898779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:12.010801 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:12.010710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:18.117499 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:18.117460    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:18.191497 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:18.191466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:18.312735 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:18.312703    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:18.404956 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:18.404865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:18.502837 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:18.502805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:24.441864 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:24.441823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:03:24.554374 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:03:24.554332    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:04:56.721569 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:04:56.721486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:05:04.872409 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:05:04.872378    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:05:04.874886 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:05:04.874864    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:05:51.071704 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:05:51.071671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:06:25.682649 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:06:25.682612    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:06:48.106874 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:06:48.106835    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:10:04.903130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:10:04.903101    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:10:04.906946 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:10:04.906920    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:11:11.026701 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:11:11.026625    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:11:12.206919 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:11:12.206881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:11:51.034606 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:11:51.034573    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:32.827251 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:32.827152    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:32.912441 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:32.912409    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:38.258935 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:38.258899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:38.319152 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:38.319122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:38.534785 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:38.534708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:38.632445 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:38.632414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:39.777521 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:39.777479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:39.952818 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:39.952789    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:40.032625 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:40.032539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:40.294231 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:40.294144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:40.470918 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:40.470882    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:40.572025 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:40.571934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:42.468660 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:42.468629    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:14:44.701385 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.701346    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"]
Jul 14 08:14:44.701956 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.701809    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c47793f1-bc3f-4820-bdc5-100262a81c83" containerName="cleanup"
Jul 14 08:14:44.701956 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.701829    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47793f1-bc3f-4820-bdc5-100262a81c83" containerName="cleanup"
Jul 14 08:14:44.701956 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.701849    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779c0268-0408-4d01-9fc9-30b0c0f092b4" containerName="authorino"
Jul 14 08:14:44.701956 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.701857    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="779c0268-0408-4d01-9fc9-30b0c0f092b4" containerName="authorino"
Jul 14 08:14:44.701956 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.701945    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="779c0268-0408-4d01-9fc9-30b0c0f092b4" containerName="authorino"
Jul 14 08:14:44.701956 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.701956    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c47793f1-bc3f-4820-bdc5-100262a81c83" containerName="cleanup"
Jul 14 08:14:44.705142 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.705121    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"
Jul 14 08:14:44.707949 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.707931    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:14:44.708064 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.707954    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:14:44.713729 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.713704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"]
Jul 14 08:14:44.835738 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.835705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf321134-2bbb-4d90-8aa2-c166ad95cf8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c\" (UID: \"bf321134-2bbb-4d90-8aa2-c166ad95cf8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"
Jul 14 08:14:44.936997 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.936960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf321134-2bbb-4d90-8aa2-c166ad95cf8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c\" (UID: \"bf321134-2bbb-4d90-8aa2-c166ad95cf8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"
Jul 14 08:14:44.937583 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:44.937565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf321134-2bbb-4d90-8aa2-c166ad95cf8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c\" (UID: \"bf321134-2bbb-4d90-8aa2-c166ad95cf8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"
Jul 14 08:14:45.015586 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:45.015551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"
Jul 14 08:14:45.147140 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:45.147111    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"]
Jul 14 08:14:45.149726 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:14:45.149692    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf321134_2bbb_4d90_8aa2_c166ad95cf8e.slice/crio-9905f4728ebdcd049a59ddcdf59753e7f9c5b823d9eb141c1a3b1515bff28986 WatchSource:0}: Error finding container 9905f4728ebdcd049a59ddcdf59753e7f9c5b823d9eb141c1a3b1515bff28986: Status 404 returned error can't find the container with id 9905f4728ebdcd049a59ddcdf59753e7f9c5b823d9eb141c1a3b1515bff28986
Jul 14 08:14:45.563219 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:45.563185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" event={"ID":"bf321134-2bbb-4d90-8aa2-c166ad95cf8e","Type":"ContainerStarted","Data":"6104ccd8cbfe98a0f3bcb9a1cbc592238a3d360b0ea26772fccd7f0a4c2b96b7"}
Jul 14 08:14:45.563393 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:45.563239    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" event={"ID":"bf321134-2bbb-4d90-8aa2-c166ad95cf8e","Type":"ContainerStarted","Data":"9905f4728ebdcd049a59ddcdf59753e7f9c5b823d9eb141c1a3b1515bff28986"}
Jul 14 08:14:45.587916 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:45.587809    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" podStartSLOduration=1.5877918850000001 podStartE2EDuration="1.587791885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:14:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:14:45.586809355 +0000 UTC m=+1481.165815693" watchObservedRunningTime="2026-07-14 08:14:45.587791885 +0000 UTC m=+1481.166798224"
Jul 14 08:14:46.568760 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:46.568727    2579 generic.go:356] "Generic (PLEG): container finished" podID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerID="6104ccd8cbfe98a0f3bcb9a1cbc592238a3d360b0ea26772fccd7f0a4c2b96b7" exitCode=7
Jul 14 08:14:46.569191 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:46.568819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" event={"ID":"bf321134-2bbb-4d90-8aa2-c166ad95cf8e","Type":"ContainerDied","Data":"6104ccd8cbfe98a0f3bcb9a1cbc592238a3d360b0ea26772fccd7f0a4c2b96b7"}
Jul 14 08:14:46.569191 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:46.568950    2579 scope.go:117] "RemoveContainer" containerID="6104ccd8cbfe98a0f3bcb9a1cbc592238a3d360b0ea26772fccd7f0a4c2b96b7"
Jul 14 08:14:47.576129 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:47.576096    2579 generic.go:356] "Generic (PLEG): container finished" podID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerID="a79fd9f7f3ef3d7321dfa5afd1f29f7c209f867aaaedfd94f3805c236296a390" exitCode=7
Jul 14 08:14:47.576600 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:47.576180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" event={"ID":"bf321134-2bbb-4d90-8aa2-c166ad95cf8e","Type":"ContainerDied","Data":"a79fd9f7f3ef3d7321dfa5afd1f29f7c209f867aaaedfd94f3805c236296a390"}
Jul 14 08:14:47.576600 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:47.576237    2579 scope.go:117] "RemoveContainer" containerID="6104ccd8cbfe98a0f3bcb9a1cbc592238a3d360b0ea26772fccd7f0a4c2b96b7"
Jul 14 08:14:47.576600 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:47.576377    2579 scope.go:117] "RemoveContainer" containerID="a79fd9f7f3ef3d7321dfa5afd1f29f7c209f867aaaedfd94f3805c236296a390"
Jul 14 08:14:47.576721 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:14:47.576597    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c_odh-ai-gateway-infra(bf321134-2bbb-4d90-8aa2-c166ad95cf8e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e"
Jul 14 08:14:48.581714 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:14:48.581690    2579 scope.go:117] "RemoveContainer" containerID="a79fd9f7f3ef3d7321dfa5afd1f29f7c209f867aaaedfd94f3805c236296a390"
Jul 14 08:14:48.582079 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:14:48.581872    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c_odh-ai-gateway-infra(bf321134-2bbb-4d90-8aa2-c166ad95cf8e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e"
Jul 14 08:15:00.129655 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.129617    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"]
Jul 14 08:15:00.134529 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.134506    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl"]
Jul 14 08:15:00.134667 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.134623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"
Jul 14 08:15:00.137539 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.137519    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl"
Jul 14 08:15:00.143442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.142785    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"]
Jul 14 08:15:00.144980 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.144962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl"]
Jul 14 08:15:00.148129 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.148112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"
Jul 14 08:15:00.155173 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.155147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl"
Jul 14 08:15:00.314926 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.314902    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"]
Jul 14 08:15:00.317660 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:15:00.317632    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3351d2cd_cd24_487e_9237_f5840a496348.slice/crio-98a23a2762d1f614021037bc9f9a29244092f84af6ca8200e82a02b4253eb2d4 WatchSource:0}: Error finding container 98a23a2762d1f614021037bc9f9a29244092f84af6ca8200e82a02b4253eb2d4: Status 404 returned error can't find the container with id 98a23a2762d1f614021037bc9f9a29244092f84af6ca8200e82a02b4253eb2d4
Jul 14 08:15:00.501518 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.501492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl"]
Jul 14 08:15:00.504169 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:15:00.504143    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcad68c7_e3d0_4f78_a517_460bcd7705bc.slice/crio-67a2600752e128ff5ca81ddfe161a07be9429f4ce2799497e40d6b2cf25ff3cc WatchSource:0}: Error finding container 67a2600752e128ff5ca81ddfe161a07be9429f4ce2799497e40d6b2cf25ff3cc: Status 404 returned error can't find the container with id 67a2600752e128ff5ca81ddfe161a07be9429f4ce2799497e40d6b2cf25ff3cc
Jul 14 08:15:00.636708 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.636675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t" event={"ID":"3351d2cd-cd24-487e-9237-f5840a496348","Type":"ContainerStarted","Data":"5c23eaa3809ef574daaa20be8d27b9f4380ef04909d2e2575ecb839b8e41be8e"}
Jul 14 08:15:00.636862 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.636730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t" event={"ID":"3351d2cd-cd24-487e-9237-f5840a496348","Type":"ContainerStarted","Data":"98a23a2762d1f614021037bc9f9a29244092f84af6ca8200e82a02b4253eb2d4"}
Jul 14 08:15:00.637828 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.637803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl" event={"ID":"bcad68c7-e3d0-4f78-a517-460bcd7705bc","Type":"ContainerStarted","Data":"67a2600752e128ff5ca81ddfe161a07be9429f4ce2799497e40d6b2cf25ff3cc"}
Jul 14 08:15:00.652768 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:00.652723    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t" podStartSLOduration=0.652708385 podStartE2EDuration="652.708385ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:15:00.650820799 +0000 UTC m=+1496.229827135" watchObservedRunningTime="2026-07-14 08:15:00.652708385 +0000 UTC m=+1496.231714723"
Jul 14 08:15:01.107145 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:01.107031    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:15:01.644478 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:01.644446    2579 generic.go:356] "Generic (PLEG): container finished" podID="3351d2cd-cd24-487e-9237-f5840a496348" containerID="5c23eaa3809ef574daaa20be8d27b9f4380ef04909d2e2575ecb839b8e41be8e" exitCode=0
Jul 14 08:15:01.644925 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:01.644528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t" event={"ID":"3351d2cd-cd24-487e-9237-f5840a496348","Type":"ContainerDied","Data":"5c23eaa3809ef574daaa20be8d27b9f4380ef04909d2e2575ecb839b8e41be8e"}
Jul 14 08:15:01.645982 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:01.645959    2579 generic.go:356] "Generic (PLEG): container finished" podID="bcad68c7-e3d0-4f78-a517-460bcd7705bc" containerID="dcf86db6abb107db027838ee4c1c9437c719096f55d8c96685ee268a5b162a4e" exitCode=0
Jul 14 08:15:01.646082 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:01.646063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl" event={"ID":"bcad68c7-e3d0-4f78-a517-460bcd7705bc","Type":"ContainerDied","Data":"dcf86db6abb107db027838ee4c1c9437c719096f55d8c96685ee268a5b162a4e"}
Jul 14 08:15:01.979394 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:01.979359    2579 scope.go:117] "RemoveContainer" containerID="a79fd9f7f3ef3d7321dfa5afd1f29f7c209f867aaaedfd94f3805c236296a390"
Jul 14 08:15:02.653181 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:02.653151    2579 generic.go:356] "Generic (PLEG): container finished" podID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerID="4fea44ae196c84a6ef880f934bf1595d53a52f5d5689d34e62857324fb9b45a2" exitCode=0
Jul 14 08:15:02.653574 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:02.653217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" event={"ID":"bf321134-2bbb-4d90-8aa2-c166ad95cf8e","Type":"ContainerDied","Data":"4fea44ae196c84a6ef880f934bf1595d53a52f5d5689d34e62857324fb9b45a2"}
Jul 14 08:15:02.653574 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:02.653278    2579 scope.go:117] "RemoveContainer" containerID="a79fd9f7f3ef3d7321dfa5afd1f29f7c209f867aaaedfd94f3805c236296a390"
Jul 14 08:15:02.784079 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:02.783996    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl"
Jul 14 08:15:02.816648 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:02.816622    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"
Jul 14 08:15:03.658887 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.658858    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl"
Jul 14 08:15:03.658887 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.658871    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733615-4zpbl" event={"ID":"bcad68c7-e3d0-4f78-a517-460bcd7705bc","Type":"ContainerDied","Data":"67a2600752e128ff5ca81ddfe161a07be9429f4ce2799497e40d6b2cf25ff3cc"}
Jul 14 08:15:03.659426 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.658920    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67a2600752e128ff5ca81ddfe161a07be9429f4ce2799497e40d6b2cf25ff3cc"
Jul 14 08:15:03.661968 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.661947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t" event={"ID":"3351d2cd-cd24-487e-9237-f5840a496348","Type":"ContainerDied","Data":"98a23a2762d1f614021037bc9f9a29244092f84af6ca8200e82a02b4253eb2d4"}
Jul 14 08:15:03.662094 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.661967    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"
Jul 14 08:15:03.662094 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.661985    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98a23a2762d1f614021037bc9f9a29244092f84af6ca8200e82a02b4253eb2d4"
Jul 14 08:15:03.686510 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.686477    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"]
Jul 14 08:15:03.793544 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.793517    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"
Jul 14 08:15:03.912545 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.912455    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf321134-2bbb-4d90-8aa2-c166ad95cf8e-maas-api-service-ca\") pod \"bf321134-2bbb-4d90-8aa2-c166ad95cf8e\" (UID: \"bf321134-2bbb-4d90-8aa2-c166ad95cf8e\") "
Jul 14 08:15:03.912836 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:03.912814    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf321134-2bbb-4d90-8aa2-c166ad95cf8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf321134-2bbb-4d90-8aa2-c166ad95cf8e" (UID: "bf321134-2bbb-4d90-8aa2-c166ad95cf8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:15:04.013672 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.013636    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf321134-2bbb-4d90-8aa2-c166ad95cf8e-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:15:04.668220 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.668190    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"
Jul 14 08:15:04.668616 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.668189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c" event={"ID":"bf321134-2bbb-4d90-8aa2-c166ad95cf8e","Type":"ContainerDied","Data":"9905f4728ebdcd049a59ddcdf59753e7f9c5b823d9eb141c1a3b1515bff28986"}
Jul 14 08:15:04.668616 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.668337    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9905f4728ebdcd049a59ddcdf59753e7f9c5b823d9eb141c1a3b1515bff28986"
Jul 14 08:15:04.697802 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.697762    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"]
Jul 14 08:15:04.699872 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.699848    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-9nx7c"]
Jul 14 08:15:04.930027 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.929951    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:15:04.934859 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.934836    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:15:04.986574 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:04.986546    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" path="/var/lib/kubelet/pods/bf321134-2bbb-4d90-8aa2-c166ad95cf8e/volumes"
Jul 14 08:15:44.755338 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755256    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"]
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755568    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755579    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755588    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755594    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755603    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcad68c7-e3d0-4f78-a517-460bcd7705bc" containerName="cleanup"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755609    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcad68c7-e3d0-4f78-a517-460bcd7705bc" containerName="cleanup"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755625    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3351d2cd-cd24-487e-9237-f5840a496348" containerName="cleanup"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755631    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3351d2cd-cd24-487e-9237-f5840a496348" containerName="cleanup"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755639    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755644    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755710    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755716    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcad68c7-e3d0-4f78-a517-460bcd7705bc" containerName="cleanup"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755724    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3351d2cd-cd24-487e-9237-f5840a496348" containerName="cleanup"
Jul 14 08:15:44.755808 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.755733    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:15:44.758588 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.758572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"
Jul 14 08:15:44.761427 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.761398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:15:44.761427 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.761414    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:15:44.766120 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.765844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"]
Jul 14 08:15:44.880824 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.880785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d508b8-ef21-4306-b70f-513b131edffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7\" (UID: \"b7d508b8-ef21-4306-b70f-513b131edffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"
Jul 14 08:15:44.981629 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.981589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d508b8-ef21-4306-b70f-513b131edffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7\" (UID: \"b7d508b8-ef21-4306-b70f-513b131edffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"
Jul 14 08:15:44.982335 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:44.982308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d508b8-ef21-4306-b70f-513b131edffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7\" (UID: \"b7d508b8-ef21-4306-b70f-513b131edffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"
Jul 14 08:15:45.070235 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:45.070150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"
Jul 14 08:15:45.199814 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:45.199791    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"]
Jul 14 08:15:45.202372 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:15:45.202342    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d508b8_ef21_4306_b70f_513b131edffe.slice/crio-e2fc57606475aefef485802e6ebc28bf99d1ae554f1112ed33167f861fdc39ef WatchSource:0}: Error finding container e2fc57606475aefef485802e6ebc28bf99d1ae554f1112ed33167f861fdc39ef: Status 404 returned error can't find the container with id e2fc57606475aefef485802e6ebc28bf99d1ae554f1112ed33167f861fdc39ef
Jul 14 08:15:45.854571 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:45.854537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7" event={"ID":"b7d508b8-ef21-4306-b70f-513b131edffe","Type":"ContainerStarted","Data":"1624bc45eab58b1a062d5cf3c01a95d42109efc23c5d27786a06b3fdcf9bca21"}
Jul 14 08:15:45.854970 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:45.854590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7" event={"ID":"b7d508b8-ef21-4306-b70f-513b131edffe","Type":"ContainerStarted","Data":"e2fc57606475aefef485802e6ebc28bf99d1ae554f1112ed33167f861fdc39ef"}
Jul 14 08:15:45.874355 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:45.874300    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7" podStartSLOduration=1.874283487 podStartE2EDuration="1.874283487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:15:45.872104685 +0000 UTC m=+1541.451111025" watchObservedRunningTime="2026-07-14 08:15:45.874283487 +0000 UTC m=+1541.453289825"
Jul 14 08:15:46.860877 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:46.860841    2579 generic.go:356] "Generic (PLEG): container finished" podID="b7d508b8-ef21-4306-b70f-513b131edffe" containerID="1624bc45eab58b1a062d5cf3c01a95d42109efc23c5d27786a06b3fdcf9bca21" exitCode=0
Jul 14 08:15:46.861272 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:46.860927    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7" event={"ID":"b7d508b8-ef21-4306-b70f-513b131edffe","Type":"ContainerDied","Data":"1624bc45eab58b1a062d5cf3c01a95d42109efc23c5d27786a06b3fdcf9bca21"}
Jul 14 08:15:47.995371 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:47.995348    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"
Jul 14 08:15:48.108674 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:48.108638    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d508b8-ef21-4306-b70f-513b131edffe-maas-api-service-ca\") pod \"b7d508b8-ef21-4306-b70f-513b131edffe\" (UID: \"b7d508b8-ef21-4306-b70f-513b131edffe\") "
Jul 14 08:15:48.109013 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:48.108990    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7d508b8-ef21-4306-b70f-513b131edffe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b7d508b8-ef21-4306-b70f-513b131edffe" (UID: "b7d508b8-ef21-4306-b70f-513b131edffe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:15:48.210159 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:48.210078    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7d508b8-ef21-4306-b70f-513b131edffe-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:15:48.871479 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:48.871404    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7"
Jul 14 08:15:48.871633 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:48.871396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7" event={"ID":"b7d508b8-ef21-4306-b70f-513b131edffe","Type":"ContainerDied","Data":"e2fc57606475aefef485802e6ebc28bf99d1ae554f1112ed33167f861fdc39ef"}
Jul 14 08:15:48.871633 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:48.871524    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2fc57606475aefef485802e6ebc28bf99d1ae554f1112ed33167f861fdc39ef"
Jul 14 08:15:55.186244 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:55.186208    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:15:55.190167 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:55.190139    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"]
Jul 14 08:15:55.193330 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:55.193306    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b1c5cd00-29733615-jgk6t"]
Jul 14 08:15:56.984762 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:56.984731    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3351d2cd-cd24-487e-9237-f5840a496348" path="/var/lib/kubelet/pods/3351d2cd-cd24-487e-9237-f5840a496348/volumes"
Jul 14 08:15:59.843723 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:15:59.843685    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:05.732877 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:05.732843    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:05.796965 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:05.796929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:10.027844 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:10.027802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:10.394262 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:10.394182    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:10.553985 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:10.553951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:10.649315 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:10.649216    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:11.827289 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:11.827236    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:12.023943 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:12.023903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:12.123031 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:12.122939    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:12.469075 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:12.469030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:13.543507 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:13.543473    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:16.348704 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.348669    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"]
Jul 14 08:16:16.349099 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.348996    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d508b8-ef21-4306-b70f-513b131edffe" containerName="revoke-keys"
Jul 14 08:16:16.349099 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.349008    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d508b8-ef21-4306-b70f-513b131edffe" containerName="revoke-keys"
Jul 14 08:16:16.349177 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.349104    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf321134-2bbb-4d90-8aa2-c166ad95cf8e" containerName="revoke-keys"
Jul 14 08:16:16.349177 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.349114    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d508b8-ef21-4306-b70f-513b131edffe" containerName="revoke-keys"
Jul 14 08:16:16.352144 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.352122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"
Jul 14 08:16:16.354523 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.354502    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:16:16.354638 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.354528    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:16:16.358346 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.358317    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"]
Jul 14 08:16:16.459915 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.459879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2809e7b5-09f7-4f06-9dc5-8ee455dcadb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk\" (UID: \"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"
Jul 14 08:16:16.561203 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.561163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2809e7b5-09f7-4f06-9dc5-8ee455dcadb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk\" (UID: \"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"
Jul 14 08:16:16.561812 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.561790    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2809e7b5-09f7-4f06-9dc5-8ee455dcadb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk\" (UID: \"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"
Jul 14 08:16:16.664758 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.664670    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"
Jul 14 08:16:16.799269 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.799238    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"]
Jul 14 08:16:16.801752 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:16:16.801727    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2809e7b5_09f7_4f06_9dc5_8ee455dcadb0.slice/crio-28658790be48a08b03b0f17e203964581f2a8e83d303a29f1922359bca1ff0f4 WatchSource:0}: Error finding container 28658790be48a08b03b0f17e203964581f2a8e83d303a29f1922359bca1ff0f4: Status 404 returned error can't find the container with id 28658790be48a08b03b0f17e203964581f2a8e83d303a29f1922359bca1ff0f4
Jul 14 08:16:16.998181 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:16.998142    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk" event={"ID":"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0","Type":"ContainerStarted","Data":"28658790be48a08b03b0f17e203964581f2a8e83d303a29f1922359bca1ff0f4"}
Jul 14 08:16:18.004358 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:18.004320    2579 generic.go:356] "Generic (PLEG): container finished" podID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerID="70a3fcd0e89822dc470a11c8a55269a7b9e37887db917a308edc8da7641384f4" exitCode=7
Jul 14 08:16:18.004757 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:18.004402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk" event={"ID":"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0","Type":"ContainerDied","Data":"70a3fcd0e89822dc470a11c8a55269a7b9e37887db917a308edc8da7641384f4"}
Jul 14 08:16:18.004757 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:18.004589    2579 scope.go:117] "RemoveContainer" containerID="70a3fcd0e89822dc470a11c8a55269a7b9e37887db917a308edc8da7641384f4"
Jul 14 08:16:19.010791 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:19.010760    2579 generic.go:356] "Generic (PLEG): container finished" podID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerID="f814aa7393c77fc32d3d4a36ef26972adcf6c9d472847291432e0235fe6c7b0f" exitCode=7
Jul 14 08:16:19.011275 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:19.010847    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk" event={"ID":"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0","Type":"ContainerDied","Data":"f814aa7393c77fc32d3d4a36ef26972adcf6c9d472847291432e0235fe6c7b0f"}
Jul 14 08:16:19.011275 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:19.010902    2579 scope.go:117] "RemoveContainer" containerID="70a3fcd0e89822dc470a11c8a55269a7b9e37887db917a308edc8da7641384f4"
Jul 14 08:16:19.011275 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:19.011070    2579 scope.go:117] "RemoveContainer" containerID="f814aa7393c77fc32d3d4a36ef26972adcf6c9d472847291432e0235fe6c7b0f"
Jul 14 08:16:19.011441 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:16:19.011292    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk_odh-ai-gateway-infra(2809e7b5-09f7-4f06-9dc5-8ee455dcadb0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0"
Jul 14 08:16:20.017361 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:20.017329    2579 scope.go:117] "RemoveContainer" containerID="f814aa7393c77fc32d3d4a36ef26972adcf6c9d472847291432e0235fe6c7b0f"
Jul 14 08:16:20.017747 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:16:20.017524    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk_odh-ai-gateway-infra(2809e7b5-09f7-4f06-9dc5-8ee455dcadb0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0"
Jul 14 08:16:21.947805 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:21.947765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:22.543897 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:22.543863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:22.644747 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:22.644647    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:25.992767 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:25.992739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:16:32.979883 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:32.979848    2579 scope.go:117] "RemoveContainer" containerID="f814aa7393c77fc32d3d4a36ef26972adcf6c9d472847291432e0235fe6c7b0f"
Jul 14 08:16:34.084848 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:34.084749    2579 generic.go:356] "Generic (PLEG): container finished" podID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerID="c73de0f5028bd8203d9cb6bfaa9aaae76109041041050b53edb26926fc1c3ff1" exitCode=0
Jul 14 08:16:34.084848 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:34.084821    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk" event={"ID":"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0","Type":"ContainerDied","Data":"c73de0f5028bd8203d9cb6bfaa9aaae76109041041050b53edb26926fc1c3ff1"}
Jul 14 08:16:34.085377 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:34.084886    2579 scope.go:117] "RemoveContainer" containerID="f814aa7393c77fc32d3d4a36ef26972adcf6c9d472847291432e0235fe6c7b0f"
Jul 14 08:16:35.117836 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:35.117802    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"]
Jul 14 08:16:35.221754 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:35.221731    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"
Jul 14 08:16:35.317386 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:35.317344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2809e7b5-09f7-4f06-9dc5-8ee455dcadb0-maas-api-service-ca\") pod \"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0\" (UID: \"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0\") "
Jul 14 08:16:35.317773 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:35.317754    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2809e7b5-09f7-4f06-9dc5-8ee455dcadb0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" (UID: "2809e7b5-09f7-4f06-9dc5-8ee455dcadb0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:16:35.419108 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:35.419006    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2809e7b5-09f7-4f06-9dc5-8ee455dcadb0-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:16:36.096364 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:36.096335    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"
Jul 14 08:16:36.096560 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:36.096336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk" event={"ID":"2809e7b5-09f7-4f06-9dc5-8ee455dcadb0","Type":"ContainerDied","Data":"28658790be48a08b03b0f17e203964581f2a8e83d303a29f1922359bca1ff0f4"}
Jul 14 08:16:36.096560 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:36.096460    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28658790be48a08b03b0f17e203964581f2a8e83d303a29f1922359bca1ff0f4"
Jul 14 08:16:36.128992 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:36.128958    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"]
Jul 14 08:16:36.132052 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:36.132011    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-9gqtk"]
Jul 14 08:16:36.985294 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:16:36.985261    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" path="/var/lib/kubelet/pods/2809e7b5-09f7-4f06-9dc5-8ee455dcadb0/volumes"
Jul 14 08:17:06.393311 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.393217    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"]
Jul 14 08:17:06.393678 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.393565    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:06.393678 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.393577    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:06.393678 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.393600    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:06.393678 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.393606    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:06.393678 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.393653    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:06.393678 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.393664    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:06.396423 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.396407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"
Jul 14 08:17:06.399199 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.399159    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:17:06.399199 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.399189    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:17:06.404938 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.404913    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"]
Jul 14 08:17:06.510981 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.510947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8b0e81-f98d-4246-9adc-a9c783a69aa5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc\" (UID: \"1b8b0e81-f98d-4246-9adc-a9c783a69aa5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"
Jul 14 08:17:06.611599 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.611572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8b0e81-f98d-4246-9adc-a9c783a69aa5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc\" (UID: \"1b8b0e81-f98d-4246-9adc-a9c783a69aa5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"
Jul 14 08:17:06.612193 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.612173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8b0e81-f98d-4246-9adc-a9c783a69aa5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc\" (UID: \"1b8b0e81-f98d-4246-9adc-a9c783a69aa5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"
Jul 14 08:17:06.707105 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.706986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"
Jul 14 08:17:06.838099 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:06.838069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"]
Jul 14 08:17:06.840368 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:17:06.840337    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8b0e81_f98d_4246_9adc_a9c783a69aa5.slice/crio-abbc1f050b15e065aae0bccbe1adf048fc19a29f783a2fdb2deffd642fba846d WatchSource:0}: Error finding container abbc1f050b15e065aae0bccbe1adf048fc19a29f783a2fdb2deffd642fba846d: Status 404 returned error can't find the container with id abbc1f050b15e065aae0bccbe1adf048fc19a29f783a2fdb2deffd642fba846d
Jul 14 08:17:07.243439 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:07.243404    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc" event={"ID":"1b8b0e81-f98d-4246-9adc-a9c783a69aa5","Type":"ContainerStarted","Data":"b94c34ba2898cb1d6be391e5ee05b9b333bf724ecd4f6315017dadf71cadbfb9"}
Jul 14 08:17:07.243643 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:07.243451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc" event={"ID":"1b8b0e81-f98d-4246-9adc-a9c783a69aa5","Type":"ContainerStarted","Data":"abbc1f050b15e065aae0bccbe1adf048fc19a29f783a2fdb2deffd642fba846d"}
Jul 14 08:17:07.260921 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:07.260867    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc" podStartSLOduration=1.260850463 podStartE2EDuration="1.260850463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:17:07.25888644 +0000 UTC m=+1622.837892783" watchObservedRunningTime="2026-07-14 08:17:07.260850463 +0000 UTC m=+1622.839856802"
Jul 14 08:17:08.248829 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:08.248796    2579 generic.go:356] "Generic (PLEG): container finished" podID="1b8b0e81-f98d-4246-9adc-a9c783a69aa5" containerID="b94c34ba2898cb1d6be391e5ee05b9b333bf724ecd4f6315017dadf71cadbfb9" exitCode=0
Jul 14 08:17:08.249344 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:08.248853    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc" event={"ID":"1b8b0e81-f98d-4246-9adc-a9c783a69aa5","Type":"ContainerDied","Data":"b94c34ba2898cb1d6be391e5ee05b9b333bf724ecd4f6315017dadf71cadbfb9"}
Jul 14 08:17:09.383534 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:09.383507    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"
Jul 14 08:17:09.439221 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:09.439188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8b0e81-f98d-4246-9adc-a9c783a69aa5-maas-api-service-ca\") pod \"1b8b0e81-f98d-4246-9adc-a9c783a69aa5\" (UID: \"1b8b0e81-f98d-4246-9adc-a9c783a69aa5\") "
Jul 14 08:17:09.439543 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:09.439518    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b8b0e81-f98d-4246-9adc-a9c783a69aa5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b8b0e81-f98d-4246-9adc-a9c783a69aa5" (UID: "1b8b0e81-f98d-4246-9adc-a9c783a69aa5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:17:09.540827 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:09.540741    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8b0e81-f98d-4246-9adc-a9c783a69aa5-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:17:10.258755 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:10.258723    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc"
Jul 14 08:17:10.258930 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:10.258724    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc" event={"ID":"1b8b0e81-f98d-4246-9adc-a9c783a69aa5","Type":"ContainerDied","Data":"abbc1f050b15e065aae0bccbe1adf048fc19a29f783a2fdb2deffd642fba846d"}
Jul 14 08:17:10.258930 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:10.258858    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abbc1f050b15e065aae0bccbe1adf048fc19a29f783a2fdb2deffd642fba846d"
Jul 14 08:17:16.496608 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:16.496561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:16.601592 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:16.601552    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:16.941106 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:16.941006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:22.457331 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:22.457291    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:22.558148 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:22.558113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:22.667904 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:22.667864    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:22.834840 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:22.834807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:22.893763 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:22.893731    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:23.872473 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:23.872437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:23.968530 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:23.968494    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:24.076897 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:24.076859    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:24.339161 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:24.339125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:24.524849 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:24.524822    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:24.626189 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:24.626098    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:26.283259 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:26.283221    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:28.913573 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.913543    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"]
Jul 14 08:17:28.913951 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.913882    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:28.913951 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.913893    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:28.913951 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.913902    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b8b0e81-f98d-4246-9adc-a9c783a69aa5" containerName="revoke-keys"
Jul 14 08:17:28.913951 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.913907    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b8b0e81-f98d-4246-9adc-a9c783a69aa5" containerName="revoke-keys"
Jul 14 08:17:28.914102 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.913972    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b8b0e81-f98d-4246-9adc-a9c783a69aa5" containerName="revoke-keys"
Jul 14 08:17:28.914102 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.913980    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2809e7b5-09f7-4f06-9dc5-8ee455dcadb0" containerName="revoke-keys"
Jul 14 08:17:28.917064 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.917026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"
Jul 14 08:17:28.919827 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.919806    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:17:28.919827 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.919818    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:17:28.924972 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:28.924941    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"]
Jul 14 08:17:29.008376 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:29.008340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e9d2cf-1bdd-434d-ad59-1cb6670cecca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt\" (UID: \"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"
Jul 14 08:17:29.109321 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:29.109277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e9d2cf-1bdd-434d-ad59-1cb6670cecca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt\" (UID: \"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"
Jul 14 08:17:29.109913 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:29.109892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e9d2cf-1bdd-434d-ad59-1cb6670cecca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt\" (UID: \"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"
Jul 14 08:17:29.228734 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:29.228690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"
Jul 14 08:17:29.363193 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:29.363165    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"]
Jul 14 08:17:29.364163 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:17:29.364139    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e9d2cf_1bdd_434d_ad59_1cb6670cecca.slice/crio-59f999cd71a38d98f1dc934d9f970cc065995e2fdeb112cc951b7d9a90f91bf4 WatchSource:0}: Error finding container 59f999cd71a38d98f1dc934d9f970cc065995e2fdeb112cc951b7d9a90f91bf4: Status 404 returned error can't find the container with id 59f999cd71a38d98f1dc934d9f970cc065995e2fdeb112cc951b7d9a90f91bf4
Jul 14 08:17:30.355673 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:30.355639    2579 generic.go:356] "Generic (PLEG): container finished" podID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerID="83a58c5abf5f3bcc161ca33cf90a540c7b318c4d55c2da8dde76d6d984b0e7c9" exitCode=7
Jul 14 08:17:30.356090 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:30.355679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" event={"ID":"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca","Type":"ContainerDied","Data":"83a58c5abf5f3bcc161ca33cf90a540c7b318c4d55c2da8dde76d6d984b0e7c9"}
Jul 14 08:17:30.356090 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:30.355732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" event={"ID":"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca","Type":"ContainerStarted","Data":"59f999cd71a38d98f1dc934d9f970cc065995e2fdeb112cc951b7d9a90f91bf4"}
Jul 14 08:17:30.356090 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:30.355895    2579 scope.go:117] "RemoveContainer" containerID="83a58c5abf5f3bcc161ca33cf90a540c7b318c4d55c2da8dde76d6d984b0e7c9"
Jul 14 08:17:31.362057 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:31.361950    2579 generic.go:356] "Generic (PLEG): container finished" podID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerID="51ab31a70b2928a4fe5d4c215968935a7d893fb655083b0372bb969f047c741f" exitCode=7
Jul 14 08:17:31.362057 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:31.362018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" event={"ID":"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca","Type":"ContainerDied","Data":"51ab31a70b2928a4fe5d4c215968935a7d893fb655083b0372bb969f047c741f"}
Jul 14 08:17:31.362575 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:31.362097    2579 scope.go:117] "RemoveContainer" containerID="83a58c5abf5f3bcc161ca33cf90a540c7b318c4d55c2da8dde76d6d984b0e7c9"
Jul 14 08:17:31.362575 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:31.362283    2579 scope.go:117] "RemoveContainer" containerID="51ab31a70b2928a4fe5d4c215968935a7d893fb655083b0372bb969f047c741f"
Jul 14 08:17:31.362575 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:17:31.362544    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt_odh-ai-gateway-infra(f1e9d2cf-1bdd-434d-ad59-1cb6670cecca)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca"
Jul 14 08:17:32.368676 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:32.368643    2579 scope.go:117] "RemoveContainer" containerID="51ab31a70b2928a4fe5d4c215968935a7d893fb655083b0372bb969f047c741f"
Jul 14 08:17:32.369153 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:17:32.368879    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt_odh-ai-gateway-infra(f1e9d2cf-1bdd-434d-ad59-1cb6670cecca)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca"
Jul 14 08:17:34.833208 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:34.833172    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:34.933086 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:34.933053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:43.980222 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:43.980190    2579 scope.go:117] "RemoveContainer" containerID="51ab31a70b2928a4fe5d4c215968935a7d893fb655083b0372bb969f047c741f"
Jul 14 08:17:44.430444 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:44.430356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" event={"ID":"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca","Type":"ContainerStarted","Data":"8aaad5d39ac38adeb3e84cb702351d5329e8a38bb8bbb6f0bb651afcc3275c70"}
Jul 14 08:17:44.446703 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:44.446640    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" podStartSLOduration=16.446624515 podStartE2EDuration="16.446624515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:17:44.446083132 +0000 UTC m=+1660.025089466" watchObservedRunningTime="2026-07-14 08:17:44.446624515 +0000 UTC m=+1660.025630854"
Jul 14 08:17:45.436618 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:45.436583    2579 generic.go:356] "Generic (PLEG): container finished" podID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerID="8aaad5d39ac38adeb3e84cb702351d5329e8a38bb8bbb6f0bb651afcc3275c70" exitCode=0
Jul 14 08:17:45.437011 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:45.436650    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" event={"ID":"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca","Type":"ContainerDied","Data":"8aaad5d39ac38adeb3e84cb702351d5329e8a38bb8bbb6f0bb651afcc3275c70"}
Jul 14 08:17:45.437011 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:45.436709    2579 scope.go:117] "RemoveContainer" containerID="51ab31a70b2928a4fe5d4c215968935a7d893fb655083b0372bb969f047c741f"
Jul 14 08:17:45.460631 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:45.460603    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"]
Jul 14 08:17:46.579136 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:46.579111    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"
Jul 14 08:17:46.671825 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:46.671790    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e9d2cf-1bdd-434d-ad59-1cb6670cecca-maas-api-service-ca\") pod \"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca\" (UID: \"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca\") "
Jul 14 08:17:46.672218 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:46.672198    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1e9d2cf-1bdd-434d-ad59-1cb6670cecca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" (UID: "f1e9d2cf-1bdd-434d-ad59-1cb6670cecca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:17:46.772387 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:46.772344    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e9d2cf-1bdd-434d-ad59-1cb6670cecca-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:17:47.449721 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:47.449690    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"
Jul 14 08:17:47.449919 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:47.449733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt" event={"ID":"f1e9d2cf-1bdd-434d-ad59-1cb6670cecca","Type":"ContainerDied","Data":"59f999cd71a38d98f1dc934d9f970cc065995e2fdeb112cc951b7d9a90f91bf4"}
Jul 14 08:17:47.449919 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:47.449781    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59f999cd71a38d98f1dc934d9f970cc065995e2fdeb112cc951b7d9a90f91bf4"
Jul 14 08:17:47.478836 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:47.478803    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"]
Jul 14 08:17:47.482770 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:47.482742    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-tthpt"]
Jul 14 08:17:48.984836 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:48.984804    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" path="/var/lib/kubelet/pods/f1e9d2cf-1bdd-434d-ad59-1cb6670cecca/volumes"
Jul 14 08:17:49.375694 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:49.375583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:49.481293 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:49.481261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:50.130824 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:50.130784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:17:50.232018 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:17:50.231965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:18.961673 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.961642    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"]
Jul 14 08:18:18.962183 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.961974    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:18.962183 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.961985    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:18.962183 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.962005    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:18.962183 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.962011    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:18.962183 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.962097    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:18.962183 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.962106    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:18.965109 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.965091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"
Jul 14 08:18:18.967806 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.967789    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:18:18.967913 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.967811    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:18:18.972290 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:18.972244    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"]
Jul 14 08:18:19.063725 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:19.063686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e78ba99-7674-43f3-a2b2-5849018fb0d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9\" (UID: \"9e78ba99-7674-43f3-a2b2-5849018fb0d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"
Jul 14 08:18:19.164986 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:19.164937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e78ba99-7674-43f3-a2b2-5849018fb0d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9\" (UID: \"9e78ba99-7674-43f3-a2b2-5849018fb0d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"
Jul 14 08:18:19.165624 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:19.165604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e78ba99-7674-43f3-a2b2-5849018fb0d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9\" (UID: \"9e78ba99-7674-43f3-a2b2-5849018fb0d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"
Jul 14 08:18:19.276470 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:19.276432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"
Jul 14 08:18:19.408902 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:19.408876    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"]
Jul 14 08:18:19.411131 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:18:19.411105    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e78ba99_7674_43f3_a2b2_5849018fb0d8.slice/crio-fa970b76735b629b7f9198d1e6835ee34c8ac3764966311799411f39bba29073 WatchSource:0}: Error finding container fa970b76735b629b7f9198d1e6835ee34c8ac3764966311799411f39bba29073: Status 404 returned error can't find the container with id fa970b76735b629b7f9198d1e6835ee34c8ac3764966311799411f39bba29073
Jul 14 08:18:19.599569 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:19.599479    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9" event={"ID":"9e78ba99-7674-43f3-a2b2-5849018fb0d8","Type":"ContainerStarted","Data":"fa970b76735b629b7f9198d1e6835ee34c8ac3764966311799411f39bba29073"}
Jul 14 08:18:20.604924 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:20.604889    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e78ba99-7674-43f3-a2b2-5849018fb0d8" containerID="be3b53606b4a6e508948095960ca811e507454fce5a13a1c46127d6c039b86a2" exitCode=0
Jul 14 08:18:20.605323 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:20.604935    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9" event={"ID":"9e78ba99-7674-43f3-a2b2-5849018fb0d8","Type":"ContainerDied","Data":"be3b53606b4a6e508948095960ca811e507454fce5a13a1c46127d6c039b86a2"}
Jul 14 08:18:21.738221 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:21.738199    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"
Jul 14 08:18:21.890559 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:21.890470    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e78ba99-7674-43f3-a2b2-5849018fb0d8-maas-api-service-ca\") pod \"9e78ba99-7674-43f3-a2b2-5849018fb0d8\" (UID: \"9e78ba99-7674-43f3-a2b2-5849018fb0d8\") "
Jul 14 08:18:21.890871 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:21.890848    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e78ba99-7674-43f3-a2b2-5849018fb0d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9e78ba99-7674-43f3-a2b2-5849018fb0d8" (UID: "9e78ba99-7674-43f3-a2b2-5849018fb0d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:18:21.991949 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:21.991917    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e78ba99-7674-43f3-a2b2-5849018fb0d8-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:18:22.615103 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:22.615070    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9"
Jul 14 08:18:22.615103 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:22.615084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9" event={"ID":"9e78ba99-7674-43f3-a2b2-5849018fb0d8","Type":"ContainerDied","Data":"fa970b76735b629b7f9198d1e6835ee34c8ac3764966311799411f39bba29073"}
Jul 14 08:18:22.615321 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:22.615130    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa970b76735b629b7f9198d1e6835ee34c8ac3764966311799411f39bba29073"
Jul 14 08:18:29.428794 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:29.428697    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:34.058877 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:34.058821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:39.765736 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:39.765699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:39.865572 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:39.865536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:45.105233 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:45.105198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:45.414550 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:45.414512    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:46.610241 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:46.610203    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:46.712583 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:46.712549    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:46.873089 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:46.872965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:47.268223 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:47.268190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:47.368896 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:47.368865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:47.470574 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:47.470538    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:50.926849 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.926806    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"]
Jul 14 08:18:50.927306 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.927183    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e78ba99-7674-43f3-a2b2-5849018fb0d8" containerName="revoke-keys"
Jul 14 08:18:50.927306 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.927197    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e78ba99-7674-43f3-a2b2-5849018fb0d8" containerName="revoke-keys"
Jul 14 08:18:50.927306 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.927205    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:50.927306 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.927211    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:50.927306 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.927271    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e78ba99-7674-43f3-a2b2-5849018fb0d8" containerName="revoke-keys"
Jul 14 08:18:50.927306 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.927281    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1e9d2cf-1bdd-434d-ad59-1cb6670cecca" containerName="revoke-keys"
Jul 14 08:18:50.930610 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.930588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"
Jul 14 08:18:50.932954 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.932933    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:18:50.933209 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.933195    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:18:50.936773 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:50.936750    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"]
Jul 14 08:18:51.058295 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.058259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61222c3a-17f4-474c-b549-5da12cef1e66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm\" (UID: \"61222c3a-17f4-474c-b549-5da12cef1e66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"
Jul 14 08:18:51.159184 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.159143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61222c3a-17f4-474c-b549-5da12cef1e66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm\" (UID: \"61222c3a-17f4-474c-b549-5da12cef1e66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"
Jul 14 08:18:51.159779 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.159757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61222c3a-17f4-474c-b549-5da12cef1e66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm\" (UID: \"61222c3a-17f4-474c-b549-5da12cef1e66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"
Jul 14 08:18:51.242813 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.242778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"
Jul 14 08:18:51.374910 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.374885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"]
Jul 14 08:18:51.377198 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:18:51.377171    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61222c3a_17f4_474c_b549_5da12cef1e66.slice/crio-499c6c230a6474cd9b3d550fc3507afad99e9dbd892302bdf550d3bad1437389 WatchSource:0}: Error finding container 499c6c230a6474cd9b3d550fc3507afad99e9dbd892302bdf550d3bad1437389: Status 404 returned error can't find the container with id 499c6c230a6474cd9b3d550fc3507afad99e9dbd892302bdf550d3bad1437389
Jul 14 08:18:51.602804 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.602770    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:51.704051 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.704006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:51.752836 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.752803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" event={"ID":"61222c3a-17f4-474c-b549-5da12cef1e66","Type":"ContainerStarted","Data":"e1a895c07440f94f5f80f765fd282f3ac93dd90a9521f61e14eeb936a93e6eb9"}
Jul 14 08:18:51.753026 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.752853    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" event={"ID":"61222c3a-17f4-474c-b549-5da12cef1e66","Type":"ContainerStarted","Data":"499c6c230a6474cd9b3d550fc3507afad99e9dbd892302bdf550d3bad1437389"}
Jul 14 08:18:51.769015 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:51.768965    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" podStartSLOduration=1.768948591 podStartE2EDuration="1.768948591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:18:51.768362875 +0000 UTC m=+1727.347369218" watchObservedRunningTime="2026-07-14 08:18:51.768948591 +0000 UTC m=+1727.347954930"
Jul 14 08:18:52.758828 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:52.758793    2579 generic.go:356] "Generic (PLEG): container finished" podID="61222c3a-17f4-474c-b549-5da12cef1e66" containerID="e1a895c07440f94f5f80f765fd282f3ac93dd90a9521f61e14eeb936a93e6eb9" exitCode=7
Jul 14 08:18:52.759249 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:52.758877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" event={"ID":"61222c3a-17f4-474c-b549-5da12cef1e66","Type":"ContainerDied","Data":"e1a895c07440f94f5f80f765fd282f3ac93dd90a9521f61e14eeb936a93e6eb9"}
Jul 14 08:18:52.759249 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:52.759074    2579 scope.go:117] "RemoveContainer" containerID="e1a895c07440f94f5f80f765fd282f3ac93dd90a9521f61e14eeb936a93e6eb9"
Jul 14 08:18:53.766491 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:53.766458    2579 generic.go:356] "Generic (PLEG): container finished" podID="61222c3a-17f4-474c-b549-5da12cef1e66" containerID="089ebb0164139e6123922bcca64838f826b3f5276d87a9b91c0a6dd65b840ca2" exitCode=7
Jul 14 08:18:53.766904 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:53.766546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" event={"ID":"61222c3a-17f4-474c-b549-5da12cef1e66","Type":"ContainerDied","Data":"089ebb0164139e6123922bcca64838f826b3f5276d87a9b91c0a6dd65b840ca2"}
Jul 14 08:18:53.766904 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:53.766607    2579 scope.go:117] "RemoveContainer" containerID="e1a895c07440f94f5f80f765fd282f3ac93dd90a9521f61e14eeb936a93e6eb9"
Jul 14 08:18:53.766904 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:53.766824    2579 scope.go:117] "RemoveContainer" containerID="089ebb0164139e6123922bcca64838f826b3f5276d87a9b91c0a6dd65b840ca2"
Jul 14 08:18:53.767092 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:18:53.767071    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm_odh-ai-gateway-infra(61222c3a-17f4-474c-b549-5da12cef1e66)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" podUID="61222c3a-17f4-474c-b549-5da12cef1e66"
Jul 14 08:18:54.704216 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:54.704177    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:18:54.772813 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:18:54.772786    2579 scope.go:117] "RemoveContainer" containerID="089ebb0164139e6123922bcca64838f826b3f5276d87a9b91c0a6dd65b840ca2"
Jul 14 08:18:54.773235 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:18:54.772969    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm_odh-ai-gateway-infra(61222c3a-17f4-474c-b549-5da12cef1e66)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" podUID="61222c3a-17f4-474c-b549-5da12cef1e66"
Jul 14 08:19:05.979456 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:05.979421    2579 scope.go:117] "RemoveContainer" containerID="089ebb0164139e6123922bcca64838f826b3f5276d87a9b91c0a6dd65b840ca2"
Jul 14 08:19:06.836460 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:06.836373    2579 generic.go:356] "Generic (PLEG): container finished" podID="61222c3a-17f4-474c-b549-5da12cef1e66" containerID="af2560398367b5f13f0841c4a8463d4c16ef53602b6022adaccb3d947634342f" exitCode=0
Jul 14 08:19:06.836460 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:06.836437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" event={"ID":"61222c3a-17f4-474c-b549-5da12cef1e66","Type":"ContainerDied","Data":"af2560398367b5f13f0841c4a8463d4c16ef53602b6022adaccb3d947634342f"}
Jul 14 08:19:06.836696 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:06.836485    2579 scope.go:117] "RemoveContainer" containerID="089ebb0164139e6123922bcca64838f826b3f5276d87a9b91c0a6dd65b840ca2"
Jul 14 08:19:07.864718 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:07.864688    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"]
Jul 14 08:19:07.977108 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:07.977086    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"
Jul 14 08:19:08.016202 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.016161    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61222c3a-17f4-474c-b549-5da12cef1e66-maas-api-service-ca\") pod \"61222c3a-17f4-474c-b549-5da12cef1e66\" (UID: \"61222c3a-17f4-474c-b549-5da12cef1e66\") "
Jul 14 08:19:08.016485 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.016462    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61222c3a-17f4-474c-b549-5da12cef1e66-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61222c3a-17f4-474c-b549-5da12cef1e66" (UID: "61222c3a-17f4-474c-b549-5da12cef1e66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:19:08.116976 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.116892    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61222c3a-17f4-474c-b549-5da12cef1e66-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:19:08.849216 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.849181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm" event={"ID":"61222c3a-17f4-474c-b549-5da12cef1e66","Type":"ContainerDied","Data":"499c6c230a6474cd9b3d550fc3507afad99e9dbd892302bdf550d3bad1437389"}
Jul 14 08:19:08.849216 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.849210    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"
Jul 14 08:19:08.849439 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.849234    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="499c6c230a6474cd9b3d550fc3507afad99e9dbd892302bdf550d3bad1437389"
Jul 14 08:19:08.883417 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.883379    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"]
Jul 14 08:19:08.886898 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.886865    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-6r6pm"]
Jul 14 08:19:08.985160 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:08.985124    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" path="/var/lib/kubelet/pods/61222c3a-17f4-474c-b549-5da12cef1e66/volumes"
Jul 14 08:19:40.971053 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.970993    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"]
Jul 14 08:19:40.971537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.971370    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:19:40.971537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.971382    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:19:40.971537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.971391    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:19:40.971537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.971397    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:19:40.971537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.971457    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:19:40.971537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.971465    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:19:40.971537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.971471    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:19:40.974536 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.974521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"
Jul 14 08:19:40.977135 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.977103    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:19:40.977135 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.977130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:19:40.986836 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:40.986811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"]
Jul 14 08:19:41.072320 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:41.072287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1407df8-2cd6-4335-afc3-ab2037a99c93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl\" (UID: \"c1407df8-2cd6-4335-afc3-ab2037a99c93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"
Jul 14 08:19:41.173404 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:41.173365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1407df8-2cd6-4335-afc3-ab2037a99c93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl\" (UID: \"c1407df8-2cd6-4335-afc3-ab2037a99c93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"
Jul 14 08:19:41.174000 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:41.173979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1407df8-2cd6-4335-afc3-ab2037a99c93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl\" (UID: \"c1407df8-2cd6-4335-afc3-ab2037a99c93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"
Jul 14 08:19:41.286795 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:41.286706    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"
Jul 14 08:19:41.420683 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:41.420656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"]
Jul 14 08:19:41.423495 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:19:41.423462    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1407df8_2cd6_4335_afc3_ab2037a99c93.slice/crio-73da8e5146f7d48e3fec9813621a46df49b15ebb72fe3f0ac2e6a9a41acae5f4 WatchSource:0}: Error finding container 73da8e5146f7d48e3fec9813621a46df49b15ebb72fe3f0ac2e6a9a41acae5f4: Status 404 returned error can't find the container with id 73da8e5146f7d48e3fec9813621a46df49b15ebb72fe3f0ac2e6a9a41acae5f4
Jul 14 08:19:42.004622 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:42.004583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl" event={"ID":"c1407df8-2cd6-4335-afc3-ab2037a99c93","Type":"ContainerStarted","Data":"2e3ed0c2a6edb41887f3a99160375e924c5c58bde2b199e83fcf41b049c401a6"}
Jul 14 08:19:42.005010 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:42.004642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl" event={"ID":"c1407df8-2cd6-4335-afc3-ab2037a99c93","Type":"ContainerStarted","Data":"73da8e5146f7d48e3fec9813621a46df49b15ebb72fe3f0ac2e6a9a41acae5f4"}
Jul 14 08:19:42.021841 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:42.021795    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl" podStartSLOduration=2.02178055 podStartE2EDuration="2.02178055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:19:42.019935833 +0000 UTC m=+1777.598942173" watchObservedRunningTime="2026-07-14 08:19:42.02178055 +0000 UTC m=+1777.600786889"
Jul 14 08:19:43.015707 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:43.015671    2579 generic.go:356] "Generic (PLEG): container finished" podID="c1407df8-2cd6-4335-afc3-ab2037a99c93" containerID="2e3ed0c2a6edb41887f3a99160375e924c5c58bde2b199e83fcf41b049c401a6" exitCode=0
Jul 14 08:19:43.016189 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:43.015750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl" event={"ID":"c1407df8-2cd6-4335-afc3-ab2037a99c93","Type":"ContainerDied","Data":"2e3ed0c2a6edb41887f3a99160375e924c5c58bde2b199e83fcf41b049c401a6"}
Jul 14 08:19:44.147737 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:44.147706    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"
Jul 14 08:19:44.201893 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:44.201854    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1407df8-2cd6-4335-afc3-ab2037a99c93-maas-api-service-ca\") pod \"c1407df8-2cd6-4335-afc3-ab2037a99c93\" (UID: \"c1407df8-2cd6-4335-afc3-ab2037a99c93\") "
Jul 14 08:19:44.202245 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:44.202221    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1407df8-2cd6-4335-afc3-ab2037a99c93-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1407df8-2cd6-4335-afc3-ab2037a99c93" (UID: "c1407df8-2cd6-4335-afc3-ab2037a99c93"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:19:44.302651 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:44.302561    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1407df8-2cd6-4335-afc3-ab2037a99c93-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:19:45.027125 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:45.027096    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl"
Jul 14 08:19:45.027303 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:45.027099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl" event={"ID":"c1407df8-2cd6-4335-afc3-ab2037a99c93","Type":"ContainerDied","Data":"73da8e5146f7d48e3fec9813621a46df49b15ebb72fe3f0ac2e6a9a41acae5f4"}
Jul 14 08:19:45.027303 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:45.027238    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73da8e5146f7d48e3fec9813621a46df49b15ebb72fe3f0ac2e6a9a41acae5f4"
Jul 14 08:19:51.402329 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:51.402271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:19:56.056491 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:19:56.056446    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:02.061882 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:02.061844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:02.133595 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:02.133561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:04.958377 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:04.958349    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:20:04.963829 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:04.963806    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:20:06.261657 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:06.261619    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:06.878422 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:06.878375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:06.980140 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:06.980074    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:07.078626 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:07.078577    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:08.554100 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:08.554056    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:12.585529 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:12.585494    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:14.319076 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:14.319018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:14.439709 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:14.439674    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:14.522096 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:14.522058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:14.630163 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:14.630055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:15.061169 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:15.061129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:41.049581 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:41.049544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:46.849526 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:46.849467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:46.949934 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:46.949862    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:20:47.052591 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:20:47.052561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:02.910960 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:02.910920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:05.031660 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:05.031632    2579 scope.go:117] "RemoveContainer" containerID="4fea44ae196c84a6ef880f934bf1595d53a52f5d5689d34e62857324fb9b45a2"
Jul 14 08:21:05.041007 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:05.040986    2579 scope.go:117] "RemoveContainer" containerID="5c23eaa3809ef574daaa20be8d27b9f4380ef04909d2e2575ecb839b8e41be8e"
Jul 14 08:21:08.953754 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:08.953709    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:09.071743 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:09.071703    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:09.154652 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:09.154618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:19.695734 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:19.695687    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:21.377600 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:21.377560    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:26.260261 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:26.260182    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:26.367375 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:26.367342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:26.459331 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:26.459296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:26.559985 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:26.559899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:27.360850 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:27.360819    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:27.457409 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:27.457375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:27.557664 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:27.557634    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:29.234378 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:29.234341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:35.612461 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:35.612424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:35.686637 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:35.686604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:36.308223 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:36.308189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:42.220785 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:42.220746    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:42.316994 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:42.316961    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:42.473344 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:42.473247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:42.787812 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:42.787725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:42.886931 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:42.886895    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:45.957218 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:45.957185    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:46.069587 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:46.069558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:46.301604 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:46.301571    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:46.398626 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:46.398589    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:46.555498 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:46.555417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:46.849458 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:46.849365    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:46.950373 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:46.950329    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:50.509430 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:50.509393    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:51.219912 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:51.219875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:51.332621 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:51.332586    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:51.636898 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:51.636812    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:57.596023 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.595986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:57.697787 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.697757    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:21:57.966433 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.966397    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"]
Jul 14 08:21:57.966726 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.966714    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:21:57.966769 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.966728    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61222c3a-17f4-474c-b549-5da12cef1e66" containerName="revoke-keys"
Jul 14 08:21:57.966769 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.966740    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1407df8-2cd6-4335-afc3-ab2037a99c93" containerName="revoke-keys"
Jul 14 08:21:57.966769 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.966745    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1407df8-2cd6-4335-afc3-ab2037a99c93" containerName="revoke-keys"
Jul 14 08:21:57.966863 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.966810    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1407df8-2cd6-4335-afc3-ab2037a99c93" containerName="revoke-keys"
Jul 14 08:21:57.969952 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.969931    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"
Jul 14 08:21:57.972344 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.972322    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:21:57.972344 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.972330    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:21:57.977484 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:57.977383    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"]
Jul 14 08:21:58.085001 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:58.084966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/175b9c4a-7289-4203-a0d6-88b7040d83c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b112a181-jhkcm\" (UID: \"175b9c4a-7289-4203-a0d6-88b7040d83c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"
Jul 14 08:21:58.186404 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:58.186364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/175b9c4a-7289-4203-a0d6-88b7040d83c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b112a181-jhkcm\" (UID: \"175b9c4a-7289-4203-a0d6-88b7040d83c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"
Jul 14 08:21:58.186999 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:58.186978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/175b9c4a-7289-4203-a0d6-88b7040d83c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b112a181-jhkcm\" (UID: \"175b9c4a-7289-4203-a0d6-88b7040d83c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"
Jul 14 08:21:58.280849 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:58.280764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"
Jul 14 08:21:58.411555 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:58.411532    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"]
Jul 14 08:21:58.413687 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:21:58.413650    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175b9c4a_7289_4203_a0d6_88b7040d83c1.slice/crio-1f7be15d9fb00cf681493a02d6c3a9ed7442c8bbcb7406bf2d8584d1c2a68a3c WatchSource:0}: Error finding container 1f7be15d9fb00cf681493a02d6c3a9ed7442c8bbcb7406bf2d8584d1c2a68a3c: Status 404 returned error can't find the container with id 1f7be15d9fb00cf681493a02d6c3a9ed7442c8bbcb7406bf2d8584d1c2a68a3c
Jul 14 08:21:58.660163 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:58.660128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm" event={"ID":"175b9c4a-7289-4203-a0d6-88b7040d83c1","Type":"ContainerStarted","Data":"1f7be15d9fb00cf681493a02d6c3a9ed7442c8bbcb7406bf2d8584d1c2a68a3c"}
Jul 14 08:21:59.666558 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:59.666515    2579 generic.go:356] "Generic (PLEG): container finished" podID="175b9c4a-7289-4203-a0d6-88b7040d83c1" containerID="6d7450328a61767bb3e9cff1a5d01ed886c601f22aa98e294665fa409768501a" exitCode=0
Jul 14 08:21:59.666952 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:21:59.666612    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm" event={"ID":"175b9c4a-7289-4203-a0d6-88b7040d83c1","Type":"ContainerDied","Data":"6d7450328a61767bb3e9cff1a5d01ed886c601f22aa98e294665fa409768501a"}
Jul 14 08:22:00.796472 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:00.796440    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"
Jul 14 08:22:00.911391 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:00.911353    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/175b9c4a-7289-4203-a0d6-88b7040d83c1-maas-api-service-ca\") pod \"175b9c4a-7289-4203-a0d6-88b7040d83c1\" (UID: \"175b9c4a-7289-4203-a0d6-88b7040d83c1\") "
Jul 14 08:22:00.911727 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:00.911704    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/175b9c4a-7289-4203-a0d6-88b7040d83c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "175b9c4a-7289-4203-a0d6-88b7040d83c1" (UID: "175b9c4a-7289-4203-a0d6-88b7040d83c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:22:01.011925 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:01.011896    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/175b9c4a-7289-4203-a0d6-88b7040d83c1-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:22:01.678410 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:01.678381    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm"
Jul 14 08:22:01.678410 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:01.678396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b112a181-jhkcm" event={"ID":"175b9c4a-7289-4203-a0d6-88b7040d83c1","Type":"ContainerDied","Data":"1f7be15d9fb00cf681493a02d6c3a9ed7442c8bbcb7406bf2d8584d1c2a68a3c"}
Jul 14 08:22:01.678635 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:01.678445    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f7be15d9fb00cf681493a02d6c3a9ed7442c8bbcb7406bf2d8584d1c2a68a3c"
Jul 14 08:22:08.521437 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:08.521400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:13.056545 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:13.056507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:19.058343 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:19.058294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:19.130818 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:19.130785    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:21.415297 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:21.415264    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:23.747201 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:23.747160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:23.987198 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:23.987151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:24.107387 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:24.107289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:24.208498 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:24.208468    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:24.341638 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:24.341602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:30.156519 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:30.156478    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:30.257490 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:30.257457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:30.360159 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:30.360121    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:30.545160 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:30.545122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:36.301074 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:36.301019    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:36.371094 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:36.371058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:43.181956 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:43.181922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:43.507371 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:43.507341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:43.657091 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:43.657055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:46.219432 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:46.219400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:46.313194 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:46.313161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:46.393837 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:46.393793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:46.835365 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:46.835320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:47.002162 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:47.002128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:47.100958 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:47.100876    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:50.135426 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:50.135386    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:50.239280 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:50.239247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:22:50.730583 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:22:50.730552    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:01.180027 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.179942    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"]
Jul 14 08:23:01.180434 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.180339    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175b9c4a-7289-4203-a0d6-88b7040d83c1" containerName="revoke-keys"
Jul 14 08:23:01.180434 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.180354    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="175b9c4a-7289-4203-a0d6-88b7040d83c1" containerName="revoke-keys"
Jul 14 08:23:01.180434 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.180403    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="175b9c4a-7289-4203-a0d6-88b7040d83c1" containerName="revoke-keys"
Jul 14 08:23:01.183446 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.183425    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.186686 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.186662    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9a0f7fb2\"/\"openshift-service-ca.crt\""
Jul 14 08:23:01.187626 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.187602    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9a0f7fb2\"/\"e2e-lifecycle-model-9a0f7fb2-kserve-self-signed-certs\""
Jul 14 08:23:01.187791 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.187606    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9a0f7fb2\"/\"kube-root-ca.crt\""
Jul 14 08:23:01.187935 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.187920    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9a0f7fb2\"/\"default-dockercfg-nr8dv\""
Jul 14 08:23:01.193607 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.193578    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"]
Jul 14 08:23:01.226729 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.226696    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:01.228792 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.228768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk82z\" (UniqueName: \"kubernetes.io/projected/04ebae66-b45d-404f-88e2-8eaf17463178-kube-api-access-xk82z\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.228926 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.228806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-dshm\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.228926 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.228884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-home\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.228926 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.228908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ebae66-b45d-404f-88e2-8eaf17463178-tls-certs\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.229052 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.228947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-model-cache\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.229052 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.228990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-tmp-dir\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.329671 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.329641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-home\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.329671 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.329673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ebae66-b45d-404f-88e2-8eaf17463178-tls-certs\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.329935 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.329705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-model-cache\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.329935 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.329729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-tmp-dir\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.329935 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.329753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk82z\" (UniqueName: \"kubernetes.io/projected/04ebae66-b45d-404f-88e2-8eaf17463178-kube-api-access-xk82z\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.329935 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.329777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-dshm\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.330239 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.330116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-home\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.330239 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.330152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-model-cache\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.330239 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.330191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-tmp-dir\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.331939 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.331923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-dshm\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.332340 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.332319    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ebae66-b45d-404f-88e2-8eaf17463178-tls-certs\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.338676 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.338648    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk82z\" (UniqueName: \"kubernetes.io/projected/04ebae66-b45d-404f-88e2-8eaf17463178-kube-api-access-xk82z\") pod \"e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") " pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.494530 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.494496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:01.630600 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.630564    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"]
Jul 14 08:23:01.633731 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:23:01.633698    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04ebae66_b45d_404f_88e2_8eaf17463178.slice/crio-f7c26bd66ba8c9d70b7b51effadd3eca364f78a962980188ac83b4e99551cafb WatchSource:0}: Error finding container f7c26bd66ba8c9d70b7b51effadd3eca364f78a962980188ac83b4e99551cafb: Status 404 returned error can't find the container with id f7c26bd66ba8c9d70b7b51effadd3eca364f78a962980188ac83b4e99551cafb
Jul 14 08:23:01.965104 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.964979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t" event={"ID":"04ebae66-b45d-404f-88e2-8eaf17463178","Type":"ContainerStarted","Data":"245ee633e845f4842c934c8a8a40e3cac1e1c2143b61ddd436e83f857b530482"}
Jul 14 08:23:01.965104 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.965023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t" event={"ID":"04ebae66-b45d-404f-88e2-8eaf17463178","Type":"ContainerStarted","Data":"f7c26bd66ba8c9d70b7b51effadd3eca364f78a962980188ac83b4e99551cafb"}
Jul 14 08:23:01.990164 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:01.990110    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t" podStartSLOduration=0.990093394 podStartE2EDuration="990.093394ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:23:01.988315109 +0000 UTC m=+1977.567321458" watchObservedRunningTime="2026-07-14 08:23:01.990093394 +0000 UTC m=+1977.569099734"
Jul 14 08:23:05.075871 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:05.075831    2579 scope.go:117] "RemoveContainer" containerID="c73de0f5028bd8203d9cb6bfaa9aaae76109041041050b53edb26926fc1c3ff1"
Jul 14 08:23:07.833026 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:07.832987    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:07.933993 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:07.933949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:11.495116 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:11.495072    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:11.495498 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:11.495130    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:11.507787 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:11.507753    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:12.023589 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:12.023563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:16.061634 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:16.061602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:23.883170 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:23.883130    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"]
Jul 14 08:23:23.886382 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:23.886359    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"
Jul 14 08:23:23.889229 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:23.889208    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:23:23.889229 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:23.889220    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:23:23.894917 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:23.894891    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"]
Jul 14 08:23:23.933061 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:23.932991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b89d3a-9a8b-4144-b6f7-250d010f67b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4\" (UID: \"67b89d3a-9a8b-4144-b6f7-250d010f67b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"
Jul 14 08:23:24.034170 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:24.034130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b89d3a-9a8b-4144-b6f7-250d010f67b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4\" (UID: \"67b89d3a-9a8b-4144-b6f7-250d010f67b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"
Jul 14 08:23:24.034780 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:24.034759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b89d3a-9a8b-4144-b6f7-250d010f67b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4\" (UID: \"67b89d3a-9a8b-4144-b6f7-250d010f67b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"
Jul 14 08:23:24.197834 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:24.197750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"
Jul 14 08:23:24.331957 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:24.331930    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"]
Jul 14 08:23:24.334079 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:23:24.334025    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b89d3a_9a8b_4144_b6f7_250d010f67b9.slice/crio-5311e9f0f6ea6bae66e94a2603dcbf2eb222b0cecddae21df55a71f4af53b233 WatchSource:0}: Error finding container 5311e9f0f6ea6bae66e94a2603dcbf2eb222b0cecddae21df55a71f4af53b233: Status 404 returned error can't find the container with id 5311e9f0f6ea6bae66e94a2603dcbf2eb222b0cecddae21df55a71f4af53b233
Jul 14 08:23:25.072648 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:25.072618    2579 generic.go:356] "Generic (PLEG): container finished" podID="67b89d3a-9a8b-4144-b6f7-250d010f67b9" containerID="ad9d51e293de809c9c32fedd86023111b180af2f26a958e7328e2405dd2939df" exitCode=0
Jul 14 08:23:25.073055 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:25.072649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4" event={"ID":"67b89d3a-9a8b-4144-b6f7-250d010f67b9","Type":"ContainerDied","Data":"ad9d51e293de809c9c32fedd86023111b180af2f26a958e7328e2405dd2939df"}
Jul 14 08:23:25.073055 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:25.072694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4" event={"ID":"67b89d3a-9a8b-4144-b6f7-250d010f67b9","Type":"ContainerStarted","Data":"5311e9f0f6ea6bae66e94a2603dcbf2eb222b0cecddae21df55a71f4af53b233"}
Jul 14 08:23:26.206681 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:26.206657    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"
Jul 14 08:23:26.357393 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:26.357302    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b89d3a-9a8b-4144-b6f7-250d010f67b9-maas-api-service-ca\") pod \"67b89d3a-9a8b-4144-b6f7-250d010f67b9\" (UID: \"67b89d3a-9a8b-4144-b6f7-250d010f67b9\") "
Jul 14 08:23:26.357691 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:26.357664    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b89d3a-9a8b-4144-b6f7-250d010f67b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "67b89d3a-9a8b-4144-b6f7-250d010f67b9" (UID: "67b89d3a-9a8b-4144-b6f7-250d010f67b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:23:26.458388 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:26.458349    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b89d3a-9a8b-4144-b6f7-250d010f67b9-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:23:27.084870 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:27.084842    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4"
Jul 14 08:23:27.085062 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:27.084838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4" event={"ID":"67b89d3a-9a8b-4144-b6f7-250d010f67b9","Type":"ContainerDied","Data":"5311e9f0f6ea6bae66e94a2603dcbf2eb222b0cecddae21df55a71f4af53b233"}
Jul 14 08:23:27.085062 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:27.084970    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5311e9f0f6ea6bae66e94a2603dcbf2eb222b0cecddae21df55a71f4af53b233"
Jul 14 08:23:34.382886 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:34.382849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:39.055779 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:39.055747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:43.999713 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:43.999677    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"]
Jul 14 08:23:44.094736 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:44.094705    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:55.261407 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:55.261372    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:55.325521 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:55.325488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:23:59.020230 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.020188    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t" podUID="04ebae66-b45d-404f-88e2-8eaf17463178" containerName="main" containerID="cri-o://245ee633e845f4842c934c8a8a40e3cac1e1c2143b61ddd436e83f857b530482" gracePeriod=45
Jul 14 08:23:59.236681 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.236644    2579 generic.go:356] "Generic (PLEG): container finished" podID="04ebae66-b45d-404f-88e2-8eaf17463178" containerID="245ee633e845f4842c934c8a8a40e3cac1e1c2143b61ddd436e83f857b530482" exitCode=0
Jul 14 08:23:59.236841 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.236706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t" event={"ID":"04ebae66-b45d-404f-88e2-8eaf17463178","Type":"ContainerDied","Data":"245ee633e845f4842c934c8a8a40e3cac1e1c2143b61ddd436e83f857b530482"}
Jul 14 08:23:59.276109 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.276029    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:23:59.357067 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357017    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk82z\" (UniqueName: \"kubernetes.io/projected/04ebae66-b45d-404f-88e2-8eaf17463178-kube-api-access-xk82z\") pod \"04ebae66-b45d-404f-88e2-8eaf17463178\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") "
Jul 14 08:23:59.357252 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357080    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ebae66-b45d-404f-88e2-8eaf17463178-tls-certs\") pod \"04ebae66-b45d-404f-88e2-8eaf17463178\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") "
Jul 14 08:23:59.357252 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357130    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-dshm\") pod \"04ebae66-b45d-404f-88e2-8eaf17463178\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") "
Jul 14 08:23:59.357252 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357179    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-home\") pod \"04ebae66-b45d-404f-88e2-8eaf17463178\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") "
Jul 14 08:23:59.357252 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357217    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-tmp-dir\") pod \"04ebae66-b45d-404f-88e2-8eaf17463178\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") "
Jul 14 08:23:59.357457 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357283    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-model-cache\") pod \"04ebae66-b45d-404f-88e2-8eaf17463178\" (UID: \"04ebae66-b45d-404f-88e2-8eaf17463178\") "
Jul 14 08:23:59.357521 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357455    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-home" (OuterVolumeSpecName: "home") pod "04ebae66-b45d-404f-88e2-8eaf17463178" (UID: "04ebae66-b45d-404f-88e2-8eaf17463178"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:23:59.357581 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357542    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "04ebae66-b45d-404f-88e2-8eaf17463178" (UID: "04ebae66-b45d-404f-88e2-8eaf17463178"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:23:59.357625 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357581    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:23:59.357705 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.357681    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-model-cache" (OuterVolumeSpecName: "model-cache") pod "04ebae66-b45d-404f-88e2-8eaf17463178" (UID: "04ebae66-b45d-404f-88e2-8eaf17463178"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:23:59.359496 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.359466    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-dshm" (OuterVolumeSpecName: "dshm") pod "04ebae66-b45d-404f-88e2-8eaf17463178" (UID: "04ebae66-b45d-404f-88e2-8eaf17463178"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:23:59.359607 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.359553    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ebae66-b45d-404f-88e2-8eaf17463178-kube-api-access-xk82z" (OuterVolumeSpecName: "kube-api-access-xk82z") pod "04ebae66-b45d-404f-88e2-8eaf17463178" (UID: "04ebae66-b45d-404f-88e2-8eaf17463178"). InnerVolumeSpecName "kube-api-access-xk82z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:23:59.359695 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.359677    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ebae66-b45d-404f-88e2-8eaf17463178-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "04ebae66-b45d-404f-88e2-8eaf17463178" (UID: "04ebae66-b45d-404f-88e2-8eaf17463178"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:23:59.458489 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.458455    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk82z\" (UniqueName: \"kubernetes.io/projected/04ebae66-b45d-404f-88e2-8eaf17463178-kube-api-access-xk82z\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:23:59.458489 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.458482    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ebae66-b45d-404f-88e2-8eaf17463178-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:23:59.458489 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.458494    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:23:59.458738 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.458506    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:23:59.458738 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:23:59.458518    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ebae66-b45d-404f-88e2-8eaf17463178-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:24:00.242993 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:00.242951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t" event={"ID":"04ebae66-b45d-404f-88e2-8eaf17463178","Type":"ContainerDied","Data":"f7c26bd66ba8c9d70b7b51effadd3eca364f78a962980188ac83b4e99551cafb"}
Jul 14 08:24:00.242993 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:00.242962    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"
Jul 14 08:24:00.242993 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:00.242999    2579 scope.go:117] "RemoveContainer" containerID="245ee633e845f4842c934c8a8a40e3cac1e1c2143b61ddd436e83f857b530482"
Jul 14 08:24:00.279073 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:00.279029    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"]
Jul 14 08:24:00.283991 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:00.283965    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9a0f7fb2/e2e-lifecycle-model-9a0f7fb2-kserve-6446b5647-9g97t"]
Jul 14 08:24:00.985166 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:00.985130    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04ebae66-b45d-404f-88e2-8eaf17463178" path="/var/lib/kubelet/pods/04ebae66-b45d-404f-88e2-8eaf17463178/volumes"
Jul 14 08:24:05.095133 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:05.095105    2579 scope.go:117] "RemoveContainer" containerID="8aaad5d39ac38adeb3e84cb702351d5329e8a38bb8bbb6f0bb651afcc3275c70"
Jul 14 08:24:21.495706 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:21.495670    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:21.596551 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:21.596517    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:27.188499 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:27.188412    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:27.255529 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:27.255478    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:31.289025 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:31.288988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:31.532609 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:31.532574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:32.640879 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:32.640849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:32.857136 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:32.857100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:33.565473 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:33.565441    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:33.658822 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:33.658789    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:33.768862 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:33.768829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:35.157451 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:35.157415    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:40.978634 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:40.978604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:41.079729 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:41.079690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:41.682274 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:41.682239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:47.652683 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:47.652649    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:47.755222 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:47.755183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:47.854909 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:47.854877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:58.383511 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:58.383476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:24:58.752201 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:24:58.752169    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:04.987649 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:04.987607    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:25:04.992883 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:04.992860    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:25:19.708435 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:19.708399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:25.365472 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:25.365435    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:25.466230 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:25.466196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:25.718001 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:25.717967    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:26.062422 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:26.062319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:26.251931 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:26.251881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:29.088262 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:29.088218    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:29.188773 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:29.188739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:29.291930 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:29.291900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:29.615585 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:29.615555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:29.900189 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:29.900086    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:30.001526 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:30.001487    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:33.602268 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:33.602232    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:33.962152 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:33.962063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:34.287493 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:34.287457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:34.880245 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:34.880211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:37.157328 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:37.157292    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:37.253371 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:37.253336    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:37.423835 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:37.423741    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:37.880830 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:37.880774    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:37.980321 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:37.980287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:38.084278 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:38.084248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:41.677376 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:41.677329    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:46.870913 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.870877    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"]
Jul 14 08:25:46.871317 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.871247    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ebae66-b45d-404f-88e2-8eaf17463178" containerName="main"
Jul 14 08:25:46.871317 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.871258    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ebae66-b45d-404f-88e2-8eaf17463178" containerName="main"
Jul 14 08:25:46.871317 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.871276    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b89d3a-9a8b-4144-b6f7-250d010f67b9" containerName="revoke-keys"
Jul 14 08:25:46.871317 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.871282    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b89d3a-9a8b-4144-b6f7-250d010f67b9" containerName="revoke-keys"
Jul 14 08:25:46.871454 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.871338    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="04ebae66-b45d-404f-88e2-8eaf17463178" containerName="main"
Jul 14 08:25:46.871454 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.871346    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b89d3a-9a8b-4144-b6f7-250d010f67b9" containerName="revoke-keys"
Jul 14 08:25:46.874349 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.874330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:46.878088 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.878063    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5ae22d\"/\"openshift-service-ca.crt\""
Jul 14 08:25:46.878226 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.878124    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5ae22d\"/\"default-dockercfg-v9qm6\""
Jul 14 08:25:46.878226 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.878182    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5ae22d\"/\"test-model-5ae22d-kserve-self-signed-certs\""
Jul 14 08:25:46.878226 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.878206    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5ae22d\"/\"kube-root-ca.crt\""
Jul 14 08:25:46.883132 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.883110    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"]
Jul 14 08:25:46.975759 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:46.975729    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:47.014502 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.014462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-model-cache\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.014718 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.014509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tmp-dir\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.014718 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.014535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tls-certs\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.014718 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.014600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-home\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.014718 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.014690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-dshm\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.014906 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.014755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znwfb\" (UniqueName: \"kubernetes.io/projected/7f111a5f-e32b-4458-a31b-19a5a88a4fde-kube-api-access-znwfb\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116086 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tls-certs\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116264 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-home\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116264 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-dshm\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116264 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znwfb\" (UniqueName: \"kubernetes.io/projected/7f111a5f-e32b-4458-a31b-19a5a88a4fde-kube-api-access-znwfb\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116264 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-model-cache\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116425 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tmp-dir\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116579 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-home\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116669 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-model-cache\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.116742 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.116719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tmp-dir\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.118353 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.118333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-dshm\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.118603 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.118587    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tls-certs\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.127189 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.127129    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znwfb\" (UniqueName: \"kubernetes.io/projected/7f111a5f-e32b-4458-a31b-19a5a88a4fde-kube-api-access-znwfb\") pod \"test-model-5ae22d-kserve-f67dc8f67-jfclr\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") " pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.184192 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.184132    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:47.327588 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.327554    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"]
Jul 14 08:25:47.330591 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:25:47.330559    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f111a5f_e32b_4458_a31b_19a5a88a4fde.slice/crio-13539a0762a4d9152324f2ba82a24145a2502587581ab8b134ada217a7e5afdf WatchSource:0}: Error finding container 13539a0762a4d9152324f2ba82a24145a2502587581ab8b134ada217a7e5afdf: Status 404 returned error can't find the container with id 13539a0762a4d9152324f2ba82a24145a2502587581ab8b134ada217a7e5afdf
Jul 14 08:25:47.756063 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.756011    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr" event={"ID":"7f111a5f-e32b-4458-a31b-19a5a88a4fde","Type":"ContainerStarted","Data":"f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412"}
Jul 14 08:25:47.756245 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.756075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr" event={"ID":"7f111a5f-e32b-4458-a31b-19a5a88a4fde","Type":"ContainerStarted","Data":"13539a0762a4d9152324f2ba82a24145a2502587581ab8b134ada217a7e5afdf"}
Jul 14 08:25:47.775361 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:47.775310    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr" podStartSLOduration=1.7752949999999998 podStartE2EDuration="1.775295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:25:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:25:47.773362681 +0000 UTC m=+2143.352369022" watchObservedRunningTime="2026-07-14 08:25:47.775295 +0000 UTC m=+2143.354301364"
Jul 14 08:25:51.915616 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:51.915578    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:52.016669 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:52.016635    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:57.184730 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:57.184625    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:57.184730 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:57.184721    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:57.197076 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:57.197031    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:57.814522 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:57.814488    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:25:58.769226 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:58.769192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:25:58.869566 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:25:58.869508    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:26:05.125463 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:05.125430    2579 scope.go:117] "RemoveContainer" containerID="af2560398367b5f13f0841c4a8463d4c16ef53602b6022adaccb3d947634342f"
Jul 14 08:26:34.083714 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.083676    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"]
Jul 14 08:26:34.089120 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.087550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.091863 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.091840    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bf6952\"/\"kube-root-ca.crt\""
Jul 14 08:26:34.092012 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.091840    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bf6952\"/\"default-dockercfg-ngv4c\""
Jul 14 08:26:34.092012 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.091902    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bf6952\"/\"test-model-bf6952-kserve-self-signed-certs\""
Jul 14 08:26:34.092012 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.091840    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bf6952\"/\"openshift-service-ca.crt\""
Jul 14 08:26:34.097588 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.097547    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"]
Jul 14 08:26:34.109349 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.109317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:26:34.141431 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.141398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-model-cache\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.141644 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.141443    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-dshm\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.141644 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.141479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec37220f-9b28-4957-8c9a-9cbf91d38498-tls-certs\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.141644 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.141575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-tmp-dir\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.141644 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.141624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tht87\" (UniqueName: \"kubernetes.io/projected/ec37220f-9b28-4957-8c9a-9cbf91d38498-kube-api-access-tht87\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.141890 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.141661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-home\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242376 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-model-cache\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242576 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-dshm\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242576 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec37220f-9b28-4957-8c9a-9cbf91d38498-tls-certs\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242576 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-tmp-dir\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242576 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tht87\" (UniqueName: \"kubernetes.io/projected/ec37220f-9b28-4957-8c9a-9cbf91d38498-kube-api-access-tht87\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242576 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-home\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242877 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-tmp-dir\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242943 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-model-cache\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.242943 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.242901    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-home\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.244874 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.244850    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-dshm\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.245122 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.245103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec37220f-9b28-4957-8c9a-9cbf91d38498-tls-certs\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.251247 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.251219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tht87\" (UniqueName: \"kubernetes.io/projected/ec37220f-9b28-4957-8c9a-9cbf91d38498-kube-api-access-tht87\") pod \"test-model-bf6952-kserve-5957455fd9-h4th7\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") " pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.400648 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.400556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:34.539784 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.539756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"]
Jul 14 08:26:34.542590 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:26:34.542563    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec37220f_9b28_4957_8c9a_9cbf91d38498.slice/crio-3cd9e4a9eeebf337b2f5d577ce69b474df3700d704ca301d27f58fb64ff2ede5 WatchSource:0}: Error finding container 3cd9e4a9eeebf337b2f5d577ce69b474df3700d704ca301d27f58fb64ff2ede5: Status 404 returned error can't find the container with id 3cd9e4a9eeebf337b2f5d577ce69b474df3700d704ca301d27f58fb64ff2ede5
Jul 14 08:26:34.985490 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.985455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7" event={"ID":"ec37220f-9b28-4957-8c9a-9cbf91d38498","Type":"ContainerStarted","Data":"383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b"}
Jul 14 08:26:34.985668 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:34.985526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7" event={"ID":"ec37220f-9b28-4957-8c9a-9cbf91d38498","Type":"ContainerStarted","Data":"3cd9e4a9eeebf337b2f5d577ce69b474df3700d704ca301d27f58fb64ff2ede5"}
Jul 14 08:26:35.003386 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:35.003327    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7" podStartSLOduration=1.003310088 podStartE2EDuration="1.003310088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:26:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:26:35.000967828 +0000 UTC m=+2190.579974187" watchObservedRunningTime="2026-07-14 08:26:35.003310088 +0000 UTC m=+2190.582316404"
Jul 14 08:26:43.581765 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:43.581728    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:26:43.682308 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:43.682265    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:26:44.401007 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:44.400970    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:44.401230 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:44.401082    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:44.413529 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:44.413497    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:45.043456 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:45.043421    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:26:55.589149 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:55.589112    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"]
Jul 14 08:26:55.611401 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:55.611367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:26:56.503193 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.503162    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"]
Jul 14 08:26:56.534004 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.533975    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:26:56.650358 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.650318    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"]
Jul 14 08:26:56.653987 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.653970    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"
Jul 14 08:26:56.657374 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.657342    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:26:56.657374 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.657354    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:26:56.661363 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.661338    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"]
Jul 14 08:26:56.751329 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.751292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d082001-4d42-47a8-9c4f-899b8b80743d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k\" (UID: \"7d082001-4d42-47a8-9c4f-899b8b80743d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"
Jul 14 08:26:56.852390 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.852293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d082001-4d42-47a8-9c4f-899b8b80743d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k\" (UID: \"7d082001-4d42-47a8-9c4f-899b8b80743d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"
Jul 14 08:26:56.852889 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.852871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d082001-4d42-47a8-9c4f-899b8b80743d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k\" (UID: \"7d082001-4d42-47a8-9c4f-899b8b80743d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"
Jul 14 08:26:56.967503 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:56.967456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"
Jul 14 08:26:57.103265 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:57.103221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"]
Jul 14 08:26:57.105643 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:26:57.105611    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d082001_4d42_47a8_9c4f_899b8b80743d.slice/crio-e82e268c7353e89c6301d799b9ad4f53d3f291bc84c4086ca92f4ee82bd52835 WatchSource:0}: Error finding container e82e268c7353e89c6301d799b9ad4f53d3f291bc84c4086ca92f4ee82bd52835: Status 404 returned error can't find the container with id e82e268c7353e89c6301d799b9ad4f53d3f291bc84c4086ca92f4ee82bd52835
Jul 14 08:26:57.186126 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:57.186090    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:26:57.321283 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:57.321236    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:26:58.091337 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:58.091251    2579 generic.go:356] "Generic (PLEG): container finished" podID="7d082001-4d42-47a8-9c4f-899b8b80743d" containerID="92b0812753cc73b5c7545e8e7b647ca574a806c165e949c5e46b59df19647ac2" exitCode=0
Jul 14 08:26:58.091337 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:58.091288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k" event={"ID":"7d082001-4d42-47a8-9c4f-899b8b80743d","Type":"ContainerDied","Data":"92b0812753cc73b5c7545e8e7b647ca574a806c165e949c5e46b59df19647ac2"}
Jul 14 08:26:58.091337 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:58.091328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k" event={"ID":"7d082001-4d42-47a8-9c4f-899b8b80743d","Type":"ContainerStarted","Data":"e82e268c7353e89c6301d799b9ad4f53d3f291bc84c4086ca92f4ee82bd52835"}
Jul 14 08:26:59.225554 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:59.225528    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"
Jul 14 08:26:59.275943 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:59.275911    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d082001-4d42-47a8-9c4f-899b8b80743d-maas-api-service-ca\") pod \"7d082001-4d42-47a8-9c4f-899b8b80743d\" (UID: \"7d082001-4d42-47a8-9c4f-899b8b80743d\") "
Jul 14 08:26:59.276298 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:59.276274    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d082001-4d42-47a8-9c4f-899b8b80743d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d082001-4d42-47a8-9c4f-899b8b80743d" (UID: "7d082001-4d42-47a8-9c4f-899b8b80743d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:26:59.376600 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:26:59.376510    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d082001-4d42-47a8-9c4f-899b8b80743d-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:00.101790 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:00.101750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k" event={"ID":"7d082001-4d42-47a8-9c4f-899b8b80743d","Type":"ContainerDied","Data":"e82e268c7353e89c6301d799b9ad4f53d3f291bc84c4086ca92f4ee82bd52835"}
Jul 14 08:27:00.101976 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:00.101806    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e82e268c7353e89c6301d799b9ad4f53d3f291bc84c4086ca92f4ee82bd52835"
Jul 14 08:27:00.101976 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:00.101765    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k"
Jul 14 08:27:07.180642 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:07.180594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:10.609058 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.608985    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr" podUID="7f111a5f-e32b-4458-a31b-19a5a88a4fde" containerName="main" containerID="cri-o://f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412" gracePeriod=45
Jul 14 08:27:10.863980 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.863915    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:27:10.979586 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.979552    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-dshm\") pod \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") "
Jul 14 08:27:10.979586 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.979588    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tls-certs\") pod \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") "
Jul 14 08:27:10.979825 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.979651    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znwfb\" (UniqueName: \"kubernetes.io/projected/7f111a5f-e32b-4458-a31b-19a5a88a4fde-kube-api-access-znwfb\") pod \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") "
Jul 14 08:27:10.979825 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.979692    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-model-cache\") pod \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") "
Jul 14 08:27:10.979825 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.979746    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tmp-dir\") pod \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") "
Jul 14 08:27:10.979825 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.979786    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-home\") pod \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\" (UID: \"7f111a5f-e32b-4458-a31b-19a5a88a4fde\") "
Jul 14 08:27:10.980054 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.980003    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-model-cache" (OuterVolumeSpecName: "model-cache") pod "7f111a5f-e32b-4458-a31b-19a5a88a4fde" (UID: "7f111a5f-e32b-4458-a31b-19a5a88a4fde"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:27:10.980113 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.980049    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7f111a5f-e32b-4458-a31b-19a5a88a4fde" (UID: "7f111a5f-e32b-4458-a31b-19a5a88a4fde"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:27:10.980229 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.980209    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-home" (OuterVolumeSpecName: "home") pod "7f111a5f-e32b-4458-a31b-19a5a88a4fde" (UID: "7f111a5f-e32b-4458-a31b-19a5a88a4fde"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:27:10.982126 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.982098    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7f111a5f-e32b-4458-a31b-19a5a88a4fde" (UID: "7f111a5f-e32b-4458-a31b-19a5a88a4fde"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:27:10.982259 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.982234    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f111a5f-e32b-4458-a31b-19a5a88a4fde-kube-api-access-znwfb" (OuterVolumeSpecName: "kube-api-access-znwfb") pod "7f111a5f-e32b-4458-a31b-19a5a88a4fde" (UID: "7f111a5f-e32b-4458-a31b-19a5a88a4fde"). InnerVolumeSpecName "kube-api-access-znwfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:27:10.982259 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:10.982237    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-dshm" (OuterVolumeSpecName: "dshm") pod "7f111a5f-e32b-4458-a31b-19a5a88a4fde" (UID: "7f111a5f-e32b-4458-a31b-19a5a88a4fde"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:27:11.081497 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.081458    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.081497 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.081493    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.081497 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.081506    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.081758 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.081517    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f111a5f-e32b-4458-a31b-19a5a88a4fde-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.081758 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.081530    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f111a5f-e32b-4458-a31b-19a5a88a4fde-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.081758 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.081542    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znwfb\" (UniqueName: \"kubernetes.io/projected/7f111a5f-e32b-4458-a31b-19a5a88a4fde-kube-api-access-znwfb\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.160970 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.160873    2579 generic.go:356] "Generic (PLEG): container finished" podID="7f111a5f-e32b-4458-a31b-19a5a88a4fde" containerID="f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412" exitCode=0
Jul 14 08:27:11.160970 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.160920    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"
Jul 14 08:27:11.160970 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.160955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr" event={"ID":"7f111a5f-e32b-4458-a31b-19a5a88a4fde","Type":"ContainerDied","Data":"f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412"}
Jul 14 08:27:11.161237 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.160998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr" event={"ID":"7f111a5f-e32b-4458-a31b-19a5a88a4fde","Type":"ContainerDied","Data":"13539a0762a4d9152324f2ba82a24145a2502587581ab8b134ada217a7e5afdf"}
Jul 14 08:27:11.161237 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.161017    2579 scope.go:117] "RemoveContainer" containerID="f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412"
Jul 14 08:27:11.171447 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.171352    2579 scope.go:117] "RemoveContainer" containerID="f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412"
Jul 14 08:27:11.171785 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:27:11.171758    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412\": container with ID starting with f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412 not found: ID does not exist" containerID="f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412"
Jul 14 08:27:11.171876 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.171792    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412"} err="failed to get container status \"f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412\": rpc error: code = NotFound desc = could not find container \"f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412\": container with ID starting with f2d808a12c1c8c14ce49c09582573d30388a7c0f746f53e87f5dae127f8eb412 not found: ID does not exist"
Jul 14 08:27:11.179483 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.179450    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"]
Jul 14 08:27:11.183682 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.183659    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-5ae22d/test-model-5ae22d-kserve-f67dc8f67-jfclr"]
Jul 14 08:27:11.523244 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.523208    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7" podUID="ec37220f-9b28-4957-8c9a-9cbf91d38498" containerName="main" containerID="cri-o://383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b" gracePeriod=45
Jul 14 08:27:11.740626 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.740591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:11.772947 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.772924    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:27:11.887991 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.887889    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-dshm\") pod \"ec37220f-9b28-4957-8c9a-9cbf91d38498\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") "
Jul 14 08:27:11.887991 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.887936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-model-cache\") pod \"ec37220f-9b28-4957-8c9a-9cbf91d38498\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") "
Jul 14 08:27:11.887991 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.887964    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-home\") pod \"ec37220f-9b28-4957-8c9a-9cbf91d38498\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") "
Jul 14 08:27:11.887991 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.887983    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-tmp-dir\") pod \"ec37220f-9b28-4957-8c9a-9cbf91d38498\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") "
Jul 14 08:27:11.888442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.888002    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec37220f-9b28-4957-8c9a-9cbf91d38498-tls-certs\") pod \"ec37220f-9b28-4957-8c9a-9cbf91d38498\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") "
Jul 14 08:27:11.888442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.888059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tht87\" (UniqueName: \"kubernetes.io/projected/ec37220f-9b28-4957-8c9a-9cbf91d38498-kube-api-access-tht87\") pod \"ec37220f-9b28-4957-8c9a-9cbf91d38498\" (UID: \"ec37220f-9b28-4957-8c9a-9cbf91d38498\") "
Jul 14 08:27:11.888442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.888241    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec37220f-9b28-4957-8c9a-9cbf91d38498" (UID: "ec37220f-9b28-4957-8c9a-9cbf91d38498"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:27:11.888442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.888296    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec37220f-9b28-4957-8c9a-9cbf91d38498" (UID: "ec37220f-9b28-4957-8c9a-9cbf91d38498"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:27:11.888442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.888310    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-home" (OuterVolumeSpecName: "home") pod "ec37220f-9b28-4957-8c9a-9cbf91d38498" (UID: "ec37220f-9b28-4957-8c9a-9cbf91d38498"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:27:11.888442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.888397    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.888442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.888410    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.888442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.888438    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.890316 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.890287    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-dshm" (OuterVolumeSpecName: "dshm") pod "ec37220f-9b28-4957-8c9a-9cbf91d38498" (UID: "ec37220f-9b28-4957-8c9a-9cbf91d38498"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:27:11.890316 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.890304    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec37220f-9b28-4957-8c9a-9cbf91d38498-kube-api-access-tht87" (OuterVolumeSpecName: "kube-api-access-tht87") pod "ec37220f-9b28-4957-8c9a-9cbf91d38498" (UID: "ec37220f-9b28-4957-8c9a-9cbf91d38498"). InnerVolumeSpecName "kube-api-access-tht87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:27:11.890453 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.890287    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec37220f-9b28-4957-8c9a-9cbf91d38498-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec37220f-9b28-4957-8c9a-9cbf91d38498" (UID: "ec37220f-9b28-4957-8c9a-9cbf91d38498"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:27:11.989389 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.989344    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec37220f-9b28-4957-8c9a-9cbf91d38498-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.989389 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.989383    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec37220f-9b28-4957-8c9a-9cbf91d38498-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:11.989389 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:11.989395    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tht87\" (UniqueName: \"kubernetes.io/projected/ec37220f-9b28-4957-8c9a-9cbf91d38498-kube-api-access-tht87\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:12.168220 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.168131    2579 generic.go:356] "Generic (PLEG): container finished" podID="ec37220f-9b28-4957-8c9a-9cbf91d38498" containerID="383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b" exitCode=0
Jul 14 08:27:12.168220 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.168178    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"
Jul 14 08:27:12.168220 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.168203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7" event={"ID":"ec37220f-9b28-4957-8c9a-9cbf91d38498","Type":"ContainerDied","Data":"383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b"}
Jul 14 08:27:12.168490 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.168235    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7" event={"ID":"ec37220f-9b28-4957-8c9a-9cbf91d38498","Type":"ContainerDied","Data":"3cd9e4a9eeebf337b2f5d577ce69b474df3700d704ca301d27f58fb64ff2ede5"}
Jul 14 08:27:12.168490 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.168252    2579 scope.go:117] "RemoveContainer" containerID="383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b"
Jul 14 08:27:12.177381 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.177352    2579 scope.go:117] "RemoveContainer" containerID="383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b"
Jul 14 08:27:12.177676 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:27:12.177657    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b\": container with ID starting with 383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b not found: ID does not exist" containerID="383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b"
Jul 14 08:27:12.177740 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.177685    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b"} err="failed to get container status \"383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b\": rpc error: code = NotFound desc = could not find container \"383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b\": container with ID starting with 383de8bf94fc105f7c6dcbb64bc3771c268508aeb4824f4874dadb6df54b590b not found: ID does not exist"
Jul 14 08:27:12.190186 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.190157    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"]
Jul 14 08:27:12.195624 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.195601    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-bf6952/test-model-bf6952-kserve-5957455fd9-h4th7"]
Jul 14 08:27:12.985002 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.984968    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f111a5f-e32b-4458-a31b-19a5a88a4fde" path="/var/lib/kubelet/pods/7f111a5f-e32b-4458-a31b-19a5a88a4fde/volumes"
Jul 14 08:27:12.985420 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:12.985401    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec37220f-9b28-4957-8c9a-9cbf91d38498" path="/var/lib/kubelet/pods/ec37220f-9b28-4957-8c9a-9cbf91d38498/volumes"
Jul 14 08:27:17.797220 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:17.797186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:17.898546 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:17.898510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:22.448070 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.448018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:22.694342 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.694305    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:22.818161 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818126    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"]
Jul 14 08:27:22.818541 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818520    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec37220f-9b28-4957-8c9a-9cbf91d38498" containerName="main"
Jul 14 08:27:22.818541 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818539    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec37220f-9b28-4957-8c9a-9cbf91d38498" containerName="main"
Jul 14 08:27:22.818745 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818558    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f111a5f-e32b-4458-a31b-19a5a88a4fde" containerName="main"
Jul 14 08:27:22.818745 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818567    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f111a5f-e32b-4458-a31b-19a5a88a4fde" containerName="main"
Jul 14 08:27:22.818745 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818578    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d082001-4d42-47a8-9c4f-899b8b80743d" containerName="revoke-keys"
Jul 14 08:27:22.818745 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818587    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d082001-4d42-47a8-9c4f-899b8b80743d" containerName="revoke-keys"
Jul 14 08:27:22.818745 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818655    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d082001-4d42-47a8-9c4f-899b8b80743d" containerName="revoke-keys"
Jul 14 08:27:22.818745 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818663    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec37220f-9b28-4957-8c9a-9cbf91d38498" containerName="main"
Jul 14 08:27:22.818745 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.818670    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f111a5f-e32b-4458-a31b-19a5a88a4fde" containerName="main"
Jul 14 08:27:22.823023 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.823007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"
Jul 14 08:27:22.825713 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.825682    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:27:22.825713 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.825689    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:27:22.829113 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.829091    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"]
Jul 14 08:27:22.893505 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.893471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7becd5c-0e90-4f40-872b-3caf249fb29b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt\" (UID: \"a7becd5c-0e90-4f40-872b-3caf249fb29b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"
Jul 14 08:27:22.994042 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.994013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7becd5c-0e90-4f40-872b-3caf249fb29b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt\" (UID: \"a7becd5c-0e90-4f40-872b-3caf249fb29b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"
Jul 14 08:27:22.994628 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:22.994609    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7becd5c-0e90-4f40-872b-3caf249fb29b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt\" (UID: \"a7becd5c-0e90-4f40-872b-3caf249fb29b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"
Jul 14 08:27:23.135263 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:23.135163    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"
Jul 14 08:27:23.279687 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:23.279334    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"]
Jul 14 08:27:23.318066 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:23.318022    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:23.426771 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:23.426738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:24.231570 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:24.231540    2579 generic.go:356] "Generic (PLEG): container finished" podID="a7becd5c-0e90-4f40-872b-3caf249fb29b" containerID="fb419f524aae42be9a6257921a93afa2c63076ede5f22dc91434dcaa7e22690f" exitCode=0
Jul 14 08:27:24.231954 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:24.231583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt" event={"ID":"a7becd5c-0e90-4f40-872b-3caf249fb29b","Type":"ContainerDied","Data":"fb419f524aae42be9a6257921a93afa2c63076ede5f22dc91434dcaa7e22690f"}
Jul 14 08:27:24.231954 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:24.231631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt" event={"ID":"a7becd5c-0e90-4f40-872b-3caf249fb29b","Type":"ContainerStarted","Data":"07e9a6b392cc9524f83d172e9b6bef6acb60be14edd73e1407c9eacfeb5b988a"}
Jul 14 08:27:25.365222 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:25.365199    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"
Jul 14 08:27:25.519014 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:25.518922    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7becd5c-0e90-4f40-872b-3caf249fb29b-maas-api-service-ca\") pod \"a7becd5c-0e90-4f40-872b-3caf249fb29b\" (UID: \"a7becd5c-0e90-4f40-872b-3caf249fb29b\") "
Jul 14 08:27:25.519348 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:25.519324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7becd5c-0e90-4f40-872b-3caf249fb29b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a7becd5c-0e90-4f40-872b-3caf249fb29b" (UID: "a7becd5c-0e90-4f40-872b-3caf249fb29b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:27:25.620320 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:25.620281    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7becd5c-0e90-4f40-872b-3caf249fb29b-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:27:26.241317 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:26.241283    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt"
Jul 14 08:27:26.241521 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:26.241318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt" event={"ID":"a7becd5c-0e90-4f40-872b-3caf249fb29b","Type":"ContainerDied","Data":"07e9a6b392cc9524f83d172e9b6bef6acb60be14edd73e1407c9eacfeb5b988a"}
Jul 14 08:27:26.241521 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:26.241379    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07e9a6b392cc9524f83d172e9b6bef6acb60be14edd73e1407c9eacfeb5b988a"
Jul 14 08:27:33.258929 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:33.258894    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:36.484367 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:36.484309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:37.904624 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:37.904571    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:43.997595 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:43.997531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:44.096373 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:44.096342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:48.652103 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:48.652065    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:48.874242 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:48.874207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:49.235066 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:49.235002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:49.593326 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:49.593196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:49.951017 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:49.950903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:51.033587 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:51.033554    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:51.133343 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:51.133285    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:53.123957 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:53.123850    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:53.259012 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:53.258979    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:53.414974 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:53.414871    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:53.515497 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:53.515444    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:53.888343 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:53.888311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:53.990639 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:53.990601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:57.542123 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:57.542072    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:58.008074 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:58.008019    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:58.329959 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:58.329872    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:27:58.538838 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:27:58.538805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:00.946349 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:00.946317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:01.120631 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:01.120595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:01.282391 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:01.282355    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:01.382408 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:01.382361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:01.751972 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:01.751937    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:01.852601 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:01.852568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:05.348563 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:05.348521    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:13.469128 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.469093    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"]
Jul 14 08:28:13.469617 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.469462    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7becd5c-0e90-4f40-872b-3caf249fb29b" containerName="revoke-keys"
Jul 14 08:28:13.469617 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.469473    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7becd5c-0e90-4f40-872b-3caf249fb29b" containerName="revoke-keys"
Jul 14 08:28:13.469617 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.469532    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7becd5c-0e90-4f40-872b-3caf249fb29b" containerName="revoke-keys"
Jul 14 08:28:13.472713 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.472693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"
Jul 14 08:28:13.475273 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.475256    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:28:13.475384 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.475336    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:28:13.480575 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.480500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"]
Jul 14 08:28:13.544855 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.544812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b12394f-207f-4cb8-ae9e-514b106c08c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk\" (UID: \"4b12394f-207f-4cb8-ae9e-514b106c08c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"
Jul 14 08:28:13.646181 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.646139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b12394f-207f-4cb8-ae9e-514b106c08c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk\" (UID: \"4b12394f-207f-4cb8-ae9e-514b106c08c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"
Jul 14 08:28:13.646789 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.646767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b12394f-207f-4cb8-ae9e-514b106c08c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk\" (UID: \"4b12394f-207f-4cb8-ae9e-514b106c08c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"
Jul 14 08:28:13.784559 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.784465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"
Jul 14 08:28:13.923052 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.923009    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"]
Jul 14 08:28:13.926554 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:28:13.926528    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b12394f_207f_4cb8_ae9e_514b106c08c7.slice/crio-dd36046b2e28d1f041faed8d6267a99d6f78b78bc08c09668658639b72161a46 WatchSource:0}: Error finding container dd36046b2e28d1f041faed8d6267a99d6f78b78bc08c09668658639b72161a46: Status 404 returned error can't find the container with id dd36046b2e28d1f041faed8d6267a99d6f78b78bc08c09668658639b72161a46
Jul 14 08:28:13.960651 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:13.960618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:14.063120 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:14.062997    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:14.478436 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:14.478401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk" event={"ID":"4b12394f-207f-4cb8-ae9e-514b106c08c7","Type":"ContainerStarted","Data":"1206fa824d094e2f4a4bd1327f912f255e50fea3ff411ebcbde0ae59456c93a7"}
Jul 14 08:28:14.478802 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:14.478467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk" event={"ID":"4b12394f-207f-4cb8-ae9e-514b106c08c7","Type":"ContainerStarted","Data":"dd36046b2e28d1f041faed8d6267a99d6f78b78bc08c09668658639b72161a46"}
Jul 14 08:28:14.501340 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:14.501281    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk" podStartSLOduration=1.501265921 podStartE2EDuration="1.501265921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:28:14.493758561 +0000 UTC m=+2290.072764901" watchObservedRunningTime="2026-07-14 08:28:14.501265921 +0000 UTC m=+2290.080272259"
Jul 14 08:28:15.484999 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:15.484961    2579 generic.go:356] "Generic (PLEG): container finished" podID="4b12394f-207f-4cb8-ae9e-514b106c08c7" containerID="1206fa824d094e2f4a4bd1327f912f255e50fea3ff411ebcbde0ae59456c93a7" exitCode=0
Jul 14 08:28:15.485415 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:15.485066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk" event={"ID":"4b12394f-207f-4cb8-ae9e-514b106c08c7","Type":"ContainerDied","Data":"1206fa824d094e2f4a4bd1327f912f255e50fea3ff411ebcbde0ae59456c93a7"}
Jul 14 08:28:16.617742 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:16.617714    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"
Jul 14 08:28:16.773779 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:16.773691    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b12394f-207f-4cb8-ae9e-514b106c08c7-maas-api-service-ca\") pod \"4b12394f-207f-4cb8-ae9e-514b106c08c7\" (UID: \"4b12394f-207f-4cb8-ae9e-514b106c08c7\") "
Jul 14 08:28:16.774100 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:16.774030    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b12394f-207f-4cb8-ae9e-514b106c08c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b12394f-207f-4cb8-ae9e-514b106c08c7" (UID: "4b12394f-207f-4cb8-ae9e-514b106c08c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:28:16.874698 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:16.874657    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b12394f-207f-4cb8-ae9e-514b106c08c7-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:28:17.495203 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:17.495173    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk"
Jul 14 08:28:17.495392 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:17.495172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk" event={"ID":"4b12394f-207f-4cb8-ae9e-514b106c08c7","Type":"ContainerDied","Data":"dd36046b2e28d1f041faed8d6267a99d6f78b78bc08c09668658639b72161a46"}
Jul 14 08:28:17.495392 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:17.495298    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd36046b2e28d1f041faed8d6267a99d6f78b78bc08c09668658639b72161a46"
Jul 14 08:28:22.634342 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:22.634309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:22.736527 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:22.736491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:24.195478 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:24.195445    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:24.286795 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:24.286760    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:24.572875 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:24.572811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:28.579623 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:28.579575    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:34.712573 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:34.712539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:34.813292 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:34.813245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:39.305156 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.305125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:39.532361 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.532331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:39.662654 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.662572    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"]
Jul 14 08:28:39.662899 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.662888    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b12394f-207f-4cb8-ae9e-514b106c08c7" containerName="revoke-keys"
Jul 14 08:28:39.662941 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.662900    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b12394f-207f-4cb8-ae9e-514b106c08c7" containerName="revoke-keys"
Jul 14 08:28:39.662976 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.662959    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b12394f-207f-4cb8-ae9e-514b106c08c7" containerName="revoke-keys"
Jul 14 08:28:39.666078 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.666029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"
Jul 14 08:28:39.668894 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.668873    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:28:39.669024 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.668879    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:28:39.676181 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.676153    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"]
Jul 14 08:28:39.779076 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.779006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea44707-ce08-4467-bfe4-0c21f9db9092-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6\" (UID: \"bea44707-ce08-4467-bfe4-0c21f9db9092\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"
Jul 14 08:28:39.880000 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.879963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea44707-ce08-4467-bfe4-0c21f9db9092-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6\" (UID: \"bea44707-ce08-4467-bfe4-0c21f9db9092\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"
Jul 14 08:28:39.880593 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.880570    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea44707-ce08-4467-bfe4-0c21f9db9092-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6\" (UID: \"bea44707-ce08-4467-bfe4-0c21f9db9092\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"
Jul 14 08:28:39.977546 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:39.977515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"
Jul 14 08:28:40.112855 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:40.112774    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"]
Jul 14 08:28:40.118137 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:28:40.118109    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea44707_ce08_4467_bfe4_0c21f9db9092.slice/crio-cd6ca6c13e703f26310a52866de473254e8f6721bf9e28ee346dc9dd425d4bdc WatchSource:0}: Error finding container cd6ca6c13e703f26310a52866de473254e8f6721bf9e28ee346dc9dd425d4bdc: Status 404 returned error can't find the container with id cd6ca6c13e703f26310a52866de473254e8f6721bf9e28ee346dc9dd425d4bdc
Jul 14 08:28:40.233476 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:40.233388    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:40.337266 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:40.337238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:40.604622 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:40.604531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6" event={"ID":"bea44707-ce08-4467-bfe4-0c21f9db9092","Type":"ContainerStarted","Data":"29000038266e26c1f14bb50b3511059462e8f461a87f0ff1727f2bb9f399454a"}
Jul 14 08:28:40.604622 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:40.604596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6" event={"ID":"bea44707-ce08-4467-bfe4-0c21f9db9092","Type":"ContainerStarted","Data":"cd6ca6c13e703f26310a52866de473254e8f6721bf9e28ee346dc9dd425d4bdc"}
Jul 14 08:28:40.625867 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:40.625807    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6" podStartSLOduration=1.625790901 podStartE2EDuration="1.625790901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:28:40.623676386 +0000 UTC m=+2316.202682725" watchObservedRunningTime="2026-07-14 08:28:40.625790901 +0000 UTC m=+2316.204797239"
Jul 14 08:28:41.610578 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:41.610545    2579 generic.go:356] "Generic (PLEG): container finished" podID="bea44707-ce08-4467-bfe4-0c21f9db9092" containerID="29000038266e26c1f14bb50b3511059462e8f461a87f0ff1727f2bb9f399454a" exitCode=0
Jul 14 08:28:41.610960 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:41.610655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6" event={"ID":"bea44707-ce08-4467-bfe4-0c21f9db9092","Type":"ContainerDied","Data":"29000038266e26c1f14bb50b3511059462e8f461a87f0ff1727f2bb9f399454a"}
Jul 14 08:28:42.751909 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:42.751884    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"
Jul 14 08:28:42.806430 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:42.806387    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea44707-ce08-4467-bfe4-0c21f9db9092-maas-api-service-ca\") pod \"bea44707-ce08-4467-bfe4-0c21f9db9092\" (UID: \"bea44707-ce08-4467-bfe4-0c21f9db9092\") "
Jul 14 08:28:42.806772 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:42.806748    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bea44707-ce08-4467-bfe4-0c21f9db9092-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bea44707-ce08-4467-bfe4-0c21f9db9092" (UID: "bea44707-ce08-4467-bfe4-0c21f9db9092"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:28:42.907786 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:42.907697    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea44707-ce08-4467-bfe4-0c21f9db9092-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:28:43.620786 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:43.620756    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6"
Jul 14 08:28:43.620982 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:43.620756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6" event={"ID":"bea44707-ce08-4467-bfe4-0c21f9db9092","Type":"ContainerDied","Data":"cd6ca6c13e703f26310a52866de473254e8f6721bf9e28ee346dc9dd425d4bdc"}
Jul 14 08:28:43.620982 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:43.620903    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd6ca6c13e703f26310a52866de473254e8f6721bf9e28ee346dc9dd425d4bdc"
Jul 14 08:28:50.237406 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:50.237371    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:28:54.750243 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:28:54.750190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:00.493059 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:00.492956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:00.594524 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:00.594492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:05.493597 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:05.493519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:05.725022 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:05.724981    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:06.078152 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:06.078116    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:06.408091 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:06.407954    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:06.742597 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:06.742565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:09.267306 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:09.267263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:09.377566 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:09.377496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:09.474442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:09.474404    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:09.584720 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:09.584596    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:09.960267 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:09.960179    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:10.077931 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:10.077898    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:13.767749 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:13.767717    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:14.094630 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:14.094549    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:14.432860 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:14.432766    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:14.736180 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:14.736149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:17.302306 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:17.302271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:17.403668 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:17.403628    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:17.497755 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:17.497696    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:17.743674 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:17.743629    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:18.191460 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:18.191355    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:18.420575 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:18.420540    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:21.784770 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:21.784717    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:31.751025 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:31.750969    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:31.855615 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:31.855573    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:36.970619 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.970585    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"]
Jul 14 08:29:36.970981 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.970913    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea44707-ce08-4467-bfe4-0c21f9db9092" containerName="revoke-keys"
Jul 14 08:29:36.970981 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.970924    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea44707-ce08-4467-bfe4-0c21f9db9092" containerName="revoke-keys"
Jul 14 08:29:36.971145 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.971001    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea44707-ce08-4467-bfe4-0c21f9db9092" containerName="revoke-keys"
Jul 14 08:29:36.974031 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.974014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:36.976692 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.976669    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"openshift-service-ca.crt\""
Jul 14 08:29:36.976828 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.976722    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"default-dockercfg-zwclm\""
Jul 14 08:29:36.976828 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.976678    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"auth-test-model-0324b2-kserve-self-signed-certs\""
Jul 14 08:29:36.976952 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.976671    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"kube-root-ca.crt\""
Jul 14 08:29:36.987941 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:36.987918    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"]
Jul 14 08:29:37.012946 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.012915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:37.083654 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.083619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tls-certs\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.083654 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.083658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tmp-dir\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.083866 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.083716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-model-cache\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.083866 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.083739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8nm\" (UniqueName: \"kubernetes.io/projected/29f476e0-3ead-4480-815b-36bfa4c9a6f8-kube-api-access-rq8nm\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.083866 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.083780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-home\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.083866 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.083813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-dshm\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.184832 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.184791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-dshm\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.185015 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.184855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tls-certs\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.185015 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.184883    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tmp-dir\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.185015 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.184913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-model-cache\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.185015 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.184937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8nm\" (UniqueName: \"kubernetes.io/projected/29f476e0-3ead-4480-815b-36bfa4c9a6f8-kube-api-access-rq8nm\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.185015 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.184969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-home\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.185376 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.185353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tmp-dir\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.185433 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.185383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-home\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.185529 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.185513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-model-cache\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.187158 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.187144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-dshm\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.187430 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.187414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tls-certs\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.194614 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.194589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8nm\" (UniqueName: \"kubernetes.io/projected/29f476e0-3ead-4480-815b-36bfa4c9a6f8-kube-api-access-rq8nm\") pod \"auth-test-model-0324b2-kserve-857c597b8c-2f26b\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") " pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.284469 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.284384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:37.418418 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.418391    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"]
Jul 14 08:29:37.420835 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:29:37.420808    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29f476e0_3ead_4480_815b_36bfa4c9a6f8.slice/crio-d7e83f2388f310d635b7ca75567a87a87889574ddc683a9eb63bcc0d732a77f6 WatchSource:0}: Error finding container d7e83f2388f310d635b7ca75567a87a87889574ddc683a9eb63bcc0d732a77f6: Status 404 returned error can't find the container with id d7e83f2388f310d635b7ca75567a87a87889574ddc683a9eb63bcc0d732a77f6
Jul 14 08:29:37.881104 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.881068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b" event={"ID":"29f476e0-3ead-4480-815b-36bfa4c9a6f8","Type":"ContainerStarted","Data":"8abebb19c0664c99121a88216d6fc353f47f5a6ec4f26b924ea4427dfc73632f"}
Jul 14 08:29:37.881104 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.881110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b" event={"ID":"29f476e0-3ead-4480-815b-36bfa4c9a6f8","Type":"ContainerStarted","Data":"d7e83f2388f310d635b7ca75567a87a87889574ddc683a9eb63bcc0d732a77f6"}
Jul 14 08:29:37.897713 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:37.897661    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b" podStartSLOduration=1.8976445659999999 podStartE2EDuration="1.897644566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:29:37.896862373 +0000 UTC m=+2373.475868724" watchObservedRunningTime="2026-07-14 08:29:37.897644566 +0000 UTC m=+2373.476650904"
Jul 14 08:29:39.133986 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:39.133950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:39.242754 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:39.242721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:29:47.284939 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:47.284902    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:47.285416 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:47.284954    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:47.297711 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:47.297680    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:29:47.941353 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:29:47.941323    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:30:00.148990 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.148956    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"]
Jul 14 08:30:00.153113 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.153086    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"]
Jul 14 08:30:00.153272 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.153214    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"
Jul 14 08:30:00.155969 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.155946    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:30:00.156722 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.156704    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4"]
Jul 14 08:30:00.156842 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.156826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"
Jul 14 08:30:00.160275 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.160250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4"
Jul 14 08:30:00.161395 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.161364    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"]
Jul 14 08:30:00.167126 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.166201    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4"]
Jul 14 08:30:00.167674 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.167656    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"
Jul 14 08:30:00.168458 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.168435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"]
Jul 14 08:30:00.178011 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.177983    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"
Jul 14 08:30:00.215345 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.215320    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4"
Jul 14 08:30:00.334416 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.333690    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"]
Jul 14 08:30:00.338889 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:30:00.338846    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6fcf68_80d6_4cda_9f71_b01183575b15.slice/crio-4b06cd341dc977f958c4e445b4a9455878dfcb6b84e89b360d344189fabb1fe3 WatchSource:0}: Error finding container 4b06cd341dc977f958c4e445b4a9455878dfcb6b84e89b360d344189fabb1fe3: Status 404 returned error can't find the container with id 4b06cd341dc977f958c4e445b4a9455878dfcb6b84e89b360d344189fabb1fe3
Jul 14 08:30:00.359360 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.359326    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"]
Jul 14 08:30:00.360206 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:30:00.360174    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c458858_0154_4050_ad56_3758159fad18.slice/crio-e7de9aace4287a731ab37a3c97ef46a8081bb6da5bcb8992b6ce61d089de27b0 WatchSource:0}: Error finding container e7de9aace4287a731ab37a3c97ef46a8081bb6da5bcb8992b6ce61d089de27b0: Status 404 returned error can't find the container with id e7de9aace4287a731ab37a3c97ef46a8081bb6da5bcb8992b6ce61d089de27b0
Jul 14 08:30:00.384759 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.384735    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4"]
Jul 14 08:30:00.395265 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:30:00.395240    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebf9703_06ea_4dfc_b4a4_12a054c0cccb.slice/crio-4e31fba2a1414b44ae3d63cf4c47374852fa867f0dbc6e7a1478bd704cf74d68 WatchSource:0}: Error finding container 4e31fba2a1414b44ae3d63cf4c47374852fa867f0dbc6e7a1478bd704cf74d68: Status 404 returned error can't find the container with id 4e31fba2a1414b44ae3d63cf4c47374852fa867f0dbc6e7a1478bd704cf74d68
Jul 14 08:30:00.995888 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.995778    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r" event={"ID":"4c458858-0154-4050-ad56-3758159fad18","Type":"ContainerStarted","Data":"6c7c6dcda91380c117ed668ab6b5633db4942515f1cc1d6f010e98d159fb6a48"}
Jul 14 08:30:00.995888 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.995844    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r" event={"ID":"4c458858-0154-4050-ad56-3758159fad18","Type":"ContainerStarted","Data":"e7de9aace4287a731ab37a3c97ef46a8081bb6da5bcb8992b6ce61d089de27b0"}
Jul 14 08:30:00.997364 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.997339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4" event={"ID":"8ebf9703-06ea-4dfc-b4a4-12a054c0cccb","Type":"ContainerStarted","Data":"4c53bf44d94f3c1cd3dd34e72293661795023f2803ec0d77c3c2d1b0429b85a0"}
Jul 14 08:30:00.997493 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.997383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4" event={"ID":"8ebf9703-06ea-4dfc-b4a4-12a054c0cccb","Type":"ContainerStarted","Data":"4e31fba2a1414b44ae3d63cf4c47374852fa867f0dbc6e7a1478bd704cf74d68"}
Jul 14 08:30:00.998643 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.998619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t" event={"ID":"3f6fcf68-80d6-4cda-9f71-b01183575b15","Type":"ContainerStarted","Data":"daa9b277f1fa10909ea9bbc7d9c8c1f3bb5a1a2639bfa786d9c2b4a35f4dddfa"}
Jul 14 08:30:00.998741 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:00.998667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t" event={"ID":"3f6fcf68-80d6-4cda-9f71-b01183575b15","Type":"ContainerStarted","Data":"4b06cd341dc977f958c4e445b4a9455878dfcb6b84e89b360d344189fabb1fe3"}
Jul 14 08:30:01.012918 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:01.012866    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r" podStartSLOduration=1.01284792 podStartE2EDuration="1.01284792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:30:01.011958816 +0000 UTC m=+2396.590965156" watchObservedRunningTime="2026-07-14 08:30:01.01284792 +0000 UTC m=+2396.591854258"
Jul 14 08:30:01.033136 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:01.033085    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4" podStartSLOduration=1.033066962 podStartE2EDuration="1.033066962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:30:01.031916674 +0000 UTC m=+2396.610923014" watchObservedRunningTime="2026-07-14 08:30:01.033066962 +0000 UTC m=+2396.612073301"
Jul 14 08:30:01.047568 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:01.047508    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t" podStartSLOduration=1.047486035 podStartE2EDuration="1.047486035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:30:01.046928952 +0000 UTC m=+2396.625935295" watchObservedRunningTime="2026-07-14 08:30:01.047486035 +0000 UTC m=+2396.626492376"
Jul 14 08:30:02.005048 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:02.005007    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c458858-0154-4050-ad56-3758159fad18" containerID="6c7c6dcda91380c117ed668ab6b5633db4942515f1cc1d6f010e98d159fb6a48" exitCode=0
Jul 14 08:30:02.005546 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:02.005068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r" event={"ID":"4c458858-0154-4050-ad56-3758159fad18","Type":"ContainerDied","Data":"6c7c6dcda91380c117ed668ab6b5633db4942515f1cc1d6f010e98d159fb6a48"}
Jul 14 08:30:02.006530 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:02.006505    2579 generic.go:356] "Generic (PLEG): container finished" podID="8ebf9703-06ea-4dfc-b4a4-12a054c0cccb" containerID="4c53bf44d94f3c1cd3dd34e72293661795023f2803ec0d77c3c2d1b0429b85a0" exitCode=0
Jul 14 08:30:02.006662 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:02.006575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4" event={"ID":"8ebf9703-06ea-4dfc-b4a4-12a054c0cccb","Type":"ContainerDied","Data":"4c53bf44d94f3c1cd3dd34e72293661795023f2803ec0d77c3c2d1b0429b85a0"}
Jul 14 08:30:02.007875 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:02.007855    2579 generic.go:356] "Generic (PLEG): container finished" podID="3f6fcf68-80d6-4cda-9f71-b01183575b15" containerID="daa9b277f1fa10909ea9bbc7d9c8c1f3bb5a1a2639bfa786d9c2b4a35f4dddfa" exitCode=0
Jul 14 08:30:02.007975 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:02.007906    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t" event={"ID":"3f6fcf68-80d6-4cda-9f71-b01183575b15","Type":"ContainerDied","Data":"daa9b277f1fa10909ea9bbc7d9c8c1f3bb5a1a2639bfa786d9c2b4a35f4dddfa"}
Jul 14 08:30:03.171254 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:03.171220    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"
Jul 14 08:30:03.209105 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:03.209074    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4"
Jul 14 08:30:03.213796 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:03.213771    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"
Jul 14 08:30:04.021057 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.021018    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4"
Jul 14 08:30:04.021256 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.021018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733630-zrhh4" event={"ID":"8ebf9703-06ea-4dfc-b4a4-12a054c0cccb","Type":"ContainerDied","Data":"4e31fba2a1414b44ae3d63cf4c47374852fa867f0dbc6e7a1478bd704cf74d68"}
Jul 14 08:30:04.021256 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.021144    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e31fba2a1414b44ae3d63cf4c47374852fa867f0dbc6e7a1478bd704cf74d68"
Jul 14 08:30:04.022462 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.022444    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"
Jul 14 08:30:04.022582 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.022484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t" event={"ID":"3f6fcf68-80d6-4cda-9f71-b01183575b15","Type":"ContainerDied","Data":"4b06cd341dc977f958c4e445b4a9455878dfcb6b84e89b360d344189fabb1fe3"}
Jul 14 08:30:04.022582 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.022534    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b06cd341dc977f958c4e445b4a9455878dfcb6b84e89b360d344189fabb1fe3"
Jul 14 08:30:04.023807 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.023786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r" event={"ID":"4c458858-0154-4050-ad56-3758159fad18","Type":"ContainerDied","Data":"e7de9aace4287a731ab37a3c97ef46a8081bb6da5bcb8992b6ce61d089de27b0"}
Jul 14 08:30:04.023894 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.023823    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7de9aace4287a731ab37a3c97ef46a8081bb6da5bcb8992b6ce61d089de27b0"
Jul 14 08:30:04.023894 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:04.023795    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"
Jul 14 08:30:05.016729 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:05.016703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:30:05.023349 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:05.023325    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:30:15.582240 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:15.582205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:30:15.636654 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:15.636621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:30:25.677674 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.677637    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"]
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.677956    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f6fcf68-80d6-4cda-9f71-b01183575b15" containerName="cleanup"
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.677968    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f6fcf68-80d6-4cda-9f71-b01183575b15" containerName="cleanup"
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.677988    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ebf9703-06ea-4dfc-b4a4-12a054c0cccb" containerName="cleanup"
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.677994    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ebf9703-06ea-4dfc-b4a4-12a054c0cccb" containerName="cleanup"
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.678003    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c458858-0154-4050-ad56-3758159fad18" containerName="cleanup"
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.678009    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c458858-0154-4050-ad56-3758159fad18" containerName="cleanup"
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.678089    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c458858-0154-4050-ad56-3758159fad18" containerName="cleanup"
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.678097    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f6fcf68-80d6-4cda-9f71-b01183575b15" containerName="cleanup"
Jul 14 08:30:25.678130 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.678102    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ebf9703-06ea-4dfc-b4a4-12a054c0cccb" containerName="cleanup"
Jul 14 08:30:25.681208 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.681191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.684005 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.683982    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"kube-root-ca.crt\""
Jul 14 08:30:25.685145 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.685121    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"openshift-service-ca.crt\""
Jul 14 08:30:25.685256 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.685167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"auth-test-model-b9c837-kserve-self-signed-certs\""
Jul 14 08:30:25.685256 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.685204    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"default-dockercfg-b45wz\""
Jul 14 08:30:25.689376 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.689350    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"]
Jul 14 08:30:25.692333 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.692306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-tmp-dir\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.692442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.692341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-dshm\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.692442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.692365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hbnl\" (UniqueName: \"kubernetes.io/projected/80c691fe-d987-4989-a231-b8883997f28d-kube-api-access-2hbnl\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.692442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.692383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-home\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.692546 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.692483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80c691fe-d987-4989-a231-b8883997f28d-tls-certs\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.692546 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.692537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-model-cache\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793219 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-tmp-dir\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793421 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-dshm\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793421 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hbnl\" (UniqueName: \"kubernetes.io/projected/80c691fe-d987-4989-a231-b8883997f28d-kube-api-access-2hbnl\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793421 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-home\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793421 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80c691fe-d987-4989-a231-b8883997f28d-tls-certs\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793421 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-model-cache\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793693 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-tmp-dir\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793818 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-model-cache\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.793903 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.793870    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-home\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.795615 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.795585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-dshm\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.795738 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.795699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80c691fe-d987-4989-a231-b8883997f28d-tls-certs\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.802895 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.802871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hbnl\" (UniqueName: \"kubernetes.io/projected/80c691fe-d987-4989-a231-b8883997f28d-kube-api-access-2hbnl\") pod \"auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") " pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:25.869309 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.869270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:30:25.991627 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:25.991580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:26.130293 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:26.130266    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"]
Jul 14 08:30:26.132428 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:30:26.132395    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80c691fe_d987_4989_a231_b8883997f28d.slice/crio-4928180bb9cab49b2348cc899da8dd6b9d61c4254f9825dcd9f7efd92500361e WatchSource:0}: Error finding container 4928180bb9cab49b2348cc899da8dd6b9d61c4254f9825dcd9f7efd92500361e: Status 404 returned error can't find the container with id 4928180bb9cab49b2348cc899da8dd6b9d61c4254f9825dcd9f7efd92500361e
Jul 14 08:30:27.141549 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:27.141510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v" event={"ID":"80c691fe-d987-4989-a231-b8883997f28d","Type":"ContainerStarted","Data":"ecabff27abb9a20efe517d12e436ec46b332f3a0739dd551ac2c04500ed15c23"}
Jul 14 08:30:27.141958 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:27.141564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v" event={"ID":"80c691fe-d987-4989-a231-b8883997f28d","Type":"ContainerStarted","Data":"4928180bb9cab49b2348cc899da8dd6b9d61c4254f9825dcd9f7efd92500361e"}
Jul 14 08:30:27.160939 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:27.160873    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v" podStartSLOduration=2.16084889 podStartE2EDuration="2.16084889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:30:27.158652971 +0000 UTC m=+2422.737659313" watchObservedRunningTime="2026-07-14 08:30:27.16084889 +0000 UTC m=+2422.739855230"
Jul 14 08:30:35.992547 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:35.992511    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:35.993047 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:35.992562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:36.005166 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:36.005143    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:30:36.200585 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:30:36.200549    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:31:21.540471 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:31:21.540435    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:31:23.741604 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:31:23.741549    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:31:37.229779 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:31:37.229744    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:26.636147 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:26.636065    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"]
Jul 14 08:32:26.652195 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:26.652138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:27.579655 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:27.579620    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"]
Jul 14 08:32:27.600928 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:27.600899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:32.177647 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.177613    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"]
Jul 14 08:32:32.181157 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.181140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.183862 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.183834    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"sub-test-model-0324b2-kserve-self-signed-certs\""
Jul 14 08:32:32.189597 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.189568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"]
Jul 14 08:32:32.289407 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.289369    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:32.360095 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.360027    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-dshm\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.360284 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.360108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-home\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.360284 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.360225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-model-cache\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.360284 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.360254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tls-certs\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.360422 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.360282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hllr8\" (UniqueName: \"kubernetes.io/projected/be6687d5-8092-4ebe-9b5f-4357fa1b3428-kube-api-access-hllr8\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.360422 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.360325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tmp-dir\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.460962 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.460859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tmp-dir\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.460962 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.460913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-dshm\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.460962 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.460945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-home\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.461292 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.461069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-model-cache\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.461292 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.461098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tls-certs\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.461292 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.461125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hllr8\" (UniqueName: \"kubernetes.io/projected/be6687d5-8092-4ebe-9b5f-4357fa1b3428-kube-api-access-hllr8\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.461436 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.461317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tmp-dir\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.461436 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.461376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-home\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.461436 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.461396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-model-cache\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.463357 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.463323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-dshm\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.463686 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.463664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tls-certs\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.469301 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.469281    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hllr8\" (UniqueName: \"kubernetes.io/projected/be6687d5-8092-4ebe-9b5f-4357fa1b3428-kube-api-access-hllr8\") pod \"sub-test-model-0324b2-kserve-6865c768fc-29kqx\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") " pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.491150 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.491106    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:32.627333 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.627307    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"]
Jul 14 08:32:32.630010 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:32:32.629980    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe6687d5_8092_4ebe_9b5f_4357fa1b3428.slice/crio-a93a922ef0125dc4742f10ff7f16d721bbcccc6de2949d13e99703f3e45c4e44 WatchSource:0}: Error finding container a93a922ef0125dc4742f10ff7f16d721bbcccc6de2949d13e99703f3e45c4e44: Status 404 returned error can't find the container with id a93a922ef0125dc4742f10ff7f16d721bbcccc6de2949d13e99703f3e45c4e44
Jul 14 08:32:32.791317 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.791282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx" event={"ID":"be6687d5-8092-4ebe-9b5f-4357fa1b3428","Type":"ContainerStarted","Data":"35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb"}
Jul 14 08:32:32.791501 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.791326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx" event={"ID":"be6687d5-8092-4ebe-9b5f-4357fa1b3428","Type":"ContainerStarted","Data":"a93a922ef0125dc4742f10ff7f16d721bbcccc6de2949d13e99703f3e45c4e44"}
Jul 14 08:32:32.809133 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:32.809079    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx" podStartSLOduration=0.809062777 podStartE2EDuration="809.062777ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:32:32.80839569 +0000 UTC m=+2548.387402029" watchObservedRunningTime="2026-07-14 08:32:32.809062777 +0000 UTC m=+2548.388069119"
Jul 14 08:32:40.557887 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:40.557844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:40.658323 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:40.658286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:41.656388 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.656335    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b" podUID="29f476e0-3ead-4480-815b-36bfa4c9a6f8" containerName="main" containerID="cri-o://8abebb19c0664c99121a88216d6fc353f47f5a6ec4f26b924ea4427dfc73632f" gracePeriod=45
Jul 14 08:32:41.841024 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.840993    2579 generic.go:356] "Generic (PLEG): container finished" podID="29f476e0-3ead-4480-815b-36bfa4c9a6f8" containerID="8abebb19c0664c99121a88216d6fc353f47f5a6ec4f26b924ea4427dfc73632f" exitCode=0
Jul 14 08:32:41.841240 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.841063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b" event={"ID":"29f476e0-3ead-4480-815b-36bfa4c9a6f8","Type":"ContainerDied","Data":"8abebb19c0664c99121a88216d6fc353f47f5a6ec4f26b924ea4427dfc73632f"}
Jul 14 08:32:41.903385 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.903356    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:32:41.945413 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-model-cache\") pod \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") "
Jul 14 08:32:41.945413 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tls-certs\") pod \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") "
Jul 14 08:32:41.945623 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945498    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tmp-dir\") pod \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") "
Jul 14 08:32:41.945623 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945524    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-home\") pod \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") "
Jul 14 08:32:41.945623 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-dshm\") pod \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") "
Jul 14 08:32:41.945623 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945596    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq8nm\" (UniqueName: \"kubernetes.io/projected/29f476e0-3ead-4480-815b-36bfa4c9a6f8-kube-api-access-rq8nm\") pod \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\" (UID: \"29f476e0-3ead-4480-815b-36bfa4c9a6f8\") "
Jul 14 08:32:41.945828 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945623    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-model-cache" (OuterVolumeSpecName: "model-cache") pod "29f476e0-3ead-4480-815b-36bfa4c9a6f8" (UID: "29f476e0-3ead-4480-815b-36bfa4c9a6f8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:32:41.945828 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945760    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "29f476e0-3ead-4480-815b-36bfa4c9a6f8" (UID: "29f476e0-3ead-4480-815b-36bfa4c9a6f8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:32:41.945828 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945790    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-home" (OuterVolumeSpecName: "home") pod "29f476e0-3ead-4480-815b-36bfa4c9a6f8" (UID: "29f476e0-3ead-4480-815b-36bfa4c9a6f8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:32:41.945978 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945958    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:41.946055 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945980    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:41.946055 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.945989    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:41.947719 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.947694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-dshm" (OuterVolumeSpecName: "dshm") pod "29f476e0-3ead-4480-815b-36bfa4c9a6f8" (UID: "29f476e0-3ead-4480-815b-36bfa4c9a6f8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:32:41.947827 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.947753    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "29f476e0-3ead-4480-815b-36bfa4c9a6f8" (UID: "29f476e0-3ead-4480-815b-36bfa4c9a6f8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:32:41.947827 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:41.947797    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f476e0-3ead-4480-815b-36bfa4c9a6f8-kube-api-access-rq8nm" (OuterVolumeSpecName: "kube-api-access-rq8nm") pod "29f476e0-3ead-4480-815b-36bfa4c9a6f8" (UID: "29f476e0-3ead-4480-815b-36bfa4c9a6f8"). InnerVolumeSpecName "kube-api-access-rq8nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:32:42.047514 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.047456    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29f476e0-3ead-4480-815b-36bfa4c9a6f8-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:42.047514 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.047512    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29f476e0-3ead-4480-815b-36bfa4c9a6f8-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:42.047514 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.047526    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq8nm\" (UniqueName: \"kubernetes.io/projected/29f476e0-3ead-4480-815b-36bfa4c9a6f8-kube-api-access-rq8nm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:42.491430 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.491394    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:42.491430 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.491437    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:42.503978 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.503951    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:42.600079 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.600021    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v" podUID="80c691fe-d987-4989-a231-b8883997f28d" containerName="main" containerID="cri-o://ecabff27abb9a20efe517d12e436ec46b332f3a0739dd551ac2c04500ed15c23" gracePeriod=45
Jul 14 08:32:42.848824 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.848795    2579 generic.go:356] "Generic (PLEG): container finished" podID="80c691fe-d987-4989-a231-b8883997f28d" containerID="ecabff27abb9a20efe517d12e436ec46b332f3a0739dd551ac2c04500ed15c23" exitCode=0
Jul 14 08:32:42.849210 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.848869    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v" event={"ID":"80c691fe-d987-4989-a231-b8883997f28d","Type":"ContainerDied","Data":"ecabff27abb9a20efe517d12e436ec46b332f3a0739dd551ac2c04500ed15c23"}
Jul 14 08:32:42.849210 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.848907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v" event={"ID":"80c691fe-d987-4989-a231-b8883997f28d","Type":"ContainerDied","Data":"4928180bb9cab49b2348cc899da8dd6b9d61c4254f9825dcd9f7efd92500361e"}
Jul 14 08:32:42.849210 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.848922    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4928180bb9cab49b2348cc899da8dd6b9d61c4254f9825dcd9f7efd92500361e"
Jul 14 08:32:42.850315 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.850298    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"
Jul 14 08:32:42.850414 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.850308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b" event={"ID":"29f476e0-3ead-4480-815b-36bfa4c9a6f8","Type":"ContainerDied","Data":"d7e83f2388f310d635b7ca75567a87a87889574ddc683a9eb63bcc0d732a77f6"}
Jul 14 08:32:42.850414 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.850356    2579 scope.go:117] "RemoveContainer" containerID="8abebb19c0664c99121a88216d6fc353f47f5a6ec4f26b924ea4427dfc73632f"
Jul 14 08:32:42.856987 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.856966    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:32:42.864663 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.864641    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:32:42.892773 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.892730    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"]
Jul 14 08:32:42.897843 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.897812    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/auth-test-model-0324b2-kserve-857c597b8c-2f26b"]
Jul 14 08:32:42.954464 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954432    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-dshm\") pod \"80c691fe-d987-4989-a231-b8883997f28d\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") "
Jul 14 08:32:42.954641 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954470    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-home\") pod \"80c691fe-d987-4989-a231-b8883997f28d\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") "
Jul 14 08:32:42.954641 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954490    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80c691fe-d987-4989-a231-b8883997f28d-tls-certs\") pod \"80c691fe-d987-4989-a231-b8883997f28d\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") "
Jul 14 08:32:42.954641 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954545    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-tmp-dir\") pod \"80c691fe-d987-4989-a231-b8883997f28d\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") "
Jul 14 08:32:42.954641 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-model-cache\") pod \"80c691fe-d987-4989-a231-b8883997f28d\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") "
Jul 14 08:32:42.954872 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954652    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hbnl\" (UniqueName: \"kubernetes.io/projected/80c691fe-d987-4989-a231-b8883997f28d-kube-api-access-2hbnl\") pod \"80c691fe-d987-4989-a231-b8883997f28d\" (UID: \"80c691fe-d987-4989-a231-b8883997f28d\") "
Jul 14 08:32:42.954872 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954744    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-home" (OuterVolumeSpecName: "home") pod "80c691fe-d987-4989-a231-b8883997f28d" (UID: "80c691fe-d987-4989-a231-b8883997f28d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:32:42.954983 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954932    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "80c691fe-d987-4989-a231-b8883997f28d" (UID: "80c691fe-d987-4989-a231-b8883997f28d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:32:42.954983 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.954957    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-model-cache" (OuterVolumeSpecName: "model-cache") pod "80c691fe-d987-4989-a231-b8883997f28d" (UID: "80c691fe-d987-4989-a231-b8883997f28d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:32:42.955129 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.955066    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:42.955188 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.955160    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:42.956923 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.956894    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c691fe-d987-4989-a231-b8883997f28d-kube-api-access-2hbnl" (OuterVolumeSpecName: "kube-api-access-2hbnl") pod "80c691fe-d987-4989-a231-b8883997f28d" (UID: "80c691fe-d987-4989-a231-b8883997f28d"). InnerVolumeSpecName "kube-api-access-2hbnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:32:42.957056 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.956945    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c691fe-d987-4989-a231-b8883997f28d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "80c691fe-d987-4989-a231-b8883997f28d" (UID: "80c691fe-d987-4989-a231-b8883997f28d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:32:42.957056 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.956975    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-dshm" (OuterVolumeSpecName: "dshm") pod "80c691fe-d987-4989-a231-b8883997f28d" (UID: "80c691fe-d987-4989-a231-b8883997f28d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:32:42.984904 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:42.984873    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f476e0-3ead-4480-815b-36bfa4c9a6f8" path="/var/lib/kubelet/pods/29f476e0-3ead-4480-815b-36bfa4c9a6f8/volumes"
Jul 14 08:32:43.056440 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:43.056341    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:43.056440 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:43.056376    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hbnl\" (UniqueName: \"kubernetes.io/projected/80c691fe-d987-4989-a231-b8883997f28d-kube-api-access-2hbnl\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:43.056440 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:43.056386    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80c691fe-d987-4989-a231-b8883997f28d-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:43.056440 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:43.056395    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80c691fe-d987-4989-a231-b8883997f28d-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:32:43.856475 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:43.856447    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"
Jul 14 08:32:43.875045 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:43.875002    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"]
Jul 14 08:32:43.881461 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:43.881432    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/auth-test-model-b9c837-kserve-79cf9f6b99-4xl6v"]
Jul 14 08:32:44.985016 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:44.984976    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80c691fe-d987-4989-a231-b8883997f28d" path="/var/lib/kubelet/pods/80c691fe-d987-4989-a231-b8883997f28d/volumes"
Jul 14 08:32:45.387253 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:45.387158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:51.792152 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:51.792076    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:51.918019 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:51.917983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:59.179641 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.179600    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"]
Jul 14 08:32:59.180255 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.180115    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c691fe-d987-4989-a231-b8883997f28d" containerName="main"
Jul 14 08:32:59.180255 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.180136    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c691fe-d987-4989-a231-b8883997f28d" containerName="main"
Jul 14 08:32:59.180255 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.180171    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f476e0-3ead-4480-815b-36bfa4c9a6f8" containerName="main"
Jul 14 08:32:59.180255 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.180180    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f476e0-3ead-4480-815b-36bfa4c9a6f8" containerName="main"
Jul 14 08:32:59.180469 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.180264    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f476e0-3ead-4480-815b-36bfa4c9a6f8" containerName="main"
Jul 14 08:32:59.180469 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.180275    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c691fe-d987-4989-a231-b8883997f28d" containerName="main"
Jul 14 08:32:59.185000 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.184979    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.188763 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.188737    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"kube-root-ca.crt\""
Jul 14 08:32:59.189016 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.188772    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"default-dockercfg-b45wz\""
Jul 14 08:32:59.189149 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.188790    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"openshift-service-ca.crt\""
Jul 14 08:32:59.189149 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.188797    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"sub-test-model-b9c837-kserve-self-signed-certs\""
Jul 14 08:32:59.194657 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.194632    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"]
Jul 14 08:32:59.205074 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.205045    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:32:59.306842 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.306806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-dshm\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.306842 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.306841    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tls-certs\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.307150 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.306884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vt5m\" (UniqueName: \"kubernetes.io/projected/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-kube-api-access-5vt5m\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.307150 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.306943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-home\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.307150 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.306968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tmp-dir\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.307150 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.307097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-model-cache\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.411425 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.411373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vt5m\" (UniqueName: \"kubernetes.io/projected/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-kube-api-access-5vt5m\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.411652 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.411436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-home\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.411730 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.411671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tmp-dir\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.411928 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.411901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-model-cache\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.412016 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.412001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-dshm\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.412108 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.412056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tls-certs\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.412221 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.412202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-home\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.412284 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.412271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tmp-dir\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.412360 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.412344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-model-cache\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.414473 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.414442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-dshm\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.414689 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.414672    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tls-certs\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.420386 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.420363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vt5m\" (UniqueName: \"kubernetes.io/projected/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-kube-api-access-5vt5m\") pod \"sub-test-model-b9c837-kserve-6b994c8c9-4g8kq\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") " pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.495473 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.495443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:32:59.634337 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.634307    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"]
Jul 14 08:32:59.635999 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:32:59.635965    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd58792ac_2ae0_492f_b0c4_fe7ca93d5da0.slice/crio-e3f23dd9f48661377e960120177e4fda10af285894d493a4745cbbda36eaac06 WatchSource:0}: Error finding container e3f23dd9f48661377e960120177e4fda10af285894d493a4745cbbda36eaac06: Status 404 returned error can't find the container with id e3f23dd9f48661377e960120177e4fda10af285894d493a4745cbbda36eaac06
Jul 14 08:32:59.935731 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.935637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq" event={"ID":"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0","Type":"ContainerStarted","Data":"0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357"}
Jul 14 08:32:59.935731 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.935688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq" event={"ID":"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0","Type":"ContainerStarted","Data":"e3f23dd9f48661377e960120177e4fda10af285894d493a4745cbbda36eaac06"}
Jul 14 08:32:59.954219 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:32:59.954161    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq" podStartSLOduration=0.954142162 podStartE2EDuration="954.142162ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:32:59.952814422 +0000 UTC m=+2575.531820772" watchObservedRunningTime="2026-07-14 08:32:59.954142162 +0000 UTC m=+2575.533148501"
Jul 14 08:33:09.496605 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:09.496558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:33:09.497070 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:09.496626    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:33:09.509566 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:09.509535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:33:10.000689 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:10.000654    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:33:43.559902 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:43.559866    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"]
Jul 14 08:33:43.578795 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:43.578761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:33:44.463334 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:44.463290    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"]
Jul 14 08:33:44.483081 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:44.482994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:33:58.580395 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.580353    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx" podUID="be6687d5-8092-4ebe-9b5f-4357fa1b3428" containerName="main" containerID="cri-o://35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb" gracePeriod=45
Jul 14 08:33:58.831760 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.831700    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:33:58.961519 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tls-certs\") pod \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") "
Jul 14 08:33:58.961723 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961533    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-model-cache\") pod \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") "
Jul 14 08:33:58.961723 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-home\") pod \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") "
Jul 14 08:33:58.961723 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961572    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tmp-dir\") pod \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") "
Jul 14 08:33:58.961723 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961622    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-dshm\") pod \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") "
Jul 14 08:33:58.961723 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961654    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hllr8\" (UniqueName: \"kubernetes.io/projected/be6687d5-8092-4ebe-9b5f-4357fa1b3428-kube-api-access-hllr8\") pod \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\" (UID: \"be6687d5-8092-4ebe-9b5f-4357fa1b3428\") "
Jul 14 08:33:58.961975 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961829    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-home" (OuterVolumeSpecName: "home") pod "be6687d5-8092-4ebe-9b5f-4357fa1b3428" (UID: "be6687d5-8092-4ebe-9b5f-4357fa1b3428"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:33:58.961975 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961841    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-model-cache" (OuterVolumeSpecName: "model-cache") pod "be6687d5-8092-4ebe-9b5f-4357fa1b3428" (UID: "be6687d5-8092-4ebe-9b5f-4357fa1b3428"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:33:58.961975 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961877    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "be6687d5-8092-4ebe-9b5f-4357fa1b3428" (UID: "be6687d5-8092-4ebe-9b5f-4357fa1b3428"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:33:58.962154 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.961992    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:58.962154 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.962014    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:58.962154 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.962030    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:58.963847 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.963818    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "be6687d5-8092-4ebe-9b5f-4357fa1b3428" (UID: "be6687d5-8092-4ebe-9b5f-4357fa1b3428"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:33:58.963981 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.963846    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-dshm" (OuterVolumeSpecName: "dshm") pod "be6687d5-8092-4ebe-9b5f-4357fa1b3428" (UID: "be6687d5-8092-4ebe-9b5f-4357fa1b3428"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:33:58.963981 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:58.963895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6687d5-8092-4ebe-9b5f-4357fa1b3428-kube-api-access-hllr8" (OuterVolumeSpecName: "kube-api-access-hllr8") pod "be6687d5-8092-4ebe-9b5f-4357fa1b3428" (UID: "be6687d5-8092-4ebe-9b5f-4357fa1b3428"). InnerVolumeSpecName "kube-api-access-hllr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:33:59.063280 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.063245    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be6687d5-8092-4ebe-9b5f-4357fa1b3428-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:59.063280 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.063275    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be6687d5-8092-4ebe-9b5f-4357fa1b3428-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:59.063280 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.063283    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hllr8\" (UniqueName: \"kubernetes.io/projected/be6687d5-8092-4ebe-9b5f-4357fa1b3428-kube-api-access-hllr8\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:59.238543 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.238510    2579 generic.go:356] "Generic (PLEG): container finished" podID="be6687d5-8092-4ebe-9b5f-4357fa1b3428" containerID="35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb" exitCode=0
Jul 14 08:33:59.238735 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.238574    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"
Jul 14 08:33:59.238735 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.238601    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx" event={"ID":"be6687d5-8092-4ebe-9b5f-4357fa1b3428","Type":"ContainerDied","Data":"35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb"}
Jul 14 08:33:59.238735 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.238648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx" event={"ID":"be6687d5-8092-4ebe-9b5f-4357fa1b3428","Type":"ContainerDied","Data":"a93a922ef0125dc4742f10ff7f16d721bbcccc6de2949d13e99703f3e45c4e44"}
Jul 14 08:33:59.238735 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.238670    2579 scope.go:117] "RemoveContainer" containerID="35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb"
Jul 14 08:33:59.247729 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.247711    2579 scope.go:117] "RemoveContainer" containerID="35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb"
Jul 14 08:33:59.247997 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:33:59.247974    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb\": container with ID starting with 35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb not found: ID does not exist" containerID="35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb"
Jul 14 08:33:59.248069 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.248006    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb"} err="failed to get container status \"35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb\": rpc error: code = NotFound desc = could not find container \"35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb\": container with ID starting with 35cf3962ce598bba27a1778ced9c403a5bbb47151a4a0c9e278377cbd39a47cb not found: ID does not exist"
Jul 14 08:33:59.256246 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.256216    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"]
Jul 14 08:33:59.259597 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.259571    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/sub-test-model-0324b2-kserve-6865c768fc-29kqx"]
Jul 14 08:33:59.484892 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.484848    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq" podUID="d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" containerName="main" containerID="cri-o://0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357" gracePeriod=45
Jul 14 08:33:59.739733 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.739665    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:33:59.869706 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.869664    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vt5m\" (UniqueName: \"kubernetes.io/projected/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-kube-api-access-5vt5m\") pod \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") "
Jul 14 08:33:59.869706 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.869702    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-model-cache\") pod \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") "
Jul 14 08:33:59.869952 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.869728    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-dshm\") pod \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") "
Jul 14 08:33:59.869952 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.869760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-home\") pod \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") "
Jul 14 08:33:59.869952 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.869790    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tmp-dir\") pod \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") "
Jul 14 08:33:59.869952 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.869820    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tls-certs\") pod \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\" (UID: \"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0\") "
Jul 14 08:33:59.870213 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.870002    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-model-cache" (OuterVolumeSpecName: "model-cache") pod "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" (UID: "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:33:59.870213 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.870140    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-home" (OuterVolumeSpecName: "home") pod "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" (UID: "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:33:59.870213 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.870154    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" (UID: "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:33:59.870213 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.870205    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:59.870388 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.870220    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:59.872069 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.872046    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-dshm" (OuterVolumeSpecName: "dshm") pod "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" (UID: "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:33:59.872170 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.872069    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-kube-api-access-5vt5m" (OuterVolumeSpecName: "kube-api-access-5vt5m") pod "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" (UID: "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0"). InnerVolumeSpecName "kube-api-access-5vt5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:33:59.872170 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.872135    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" (UID: "d58792ac-2ae0-492f-b0c4-fe7ca93d5da0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:33:59.970817 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.970758    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vt5m\" (UniqueName: \"kubernetes.io/projected/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-kube-api-access-5vt5m\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:59.970817 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.970810    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:59.971089 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.970853    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:33:59.971089 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:33:59.970866    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:34:00.246242 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.246208    2579 generic.go:356] "Generic (PLEG): container finished" podID="d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" containerID="0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357" exitCode=0
Jul 14 08:34:00.246423 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.246253    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"
Jul 14 08:34:00.246423 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.246288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq" event={"ID":"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0","Type":"ContainerDied","Data":"0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357"}
Jul 14 08:34:00.246423 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.246333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq" event={"ID":"d58792ac-2ae0-492f-b0c4-fe7ca93d5da0","Type":"ContainerDied","Data":"e3f23dd9f48661377e960120177e4fda10af285894d493a4745cbbda36eaac06"}
Jul 14 08:34:00.246423 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.246357    2579 scope.go:117] "RemoveContainer" containerID="0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357"
Jul 14 08:34:00.256739 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.256723    2579 scope.go:117] "RemoveContainer" containerID="0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357"
Jul 14 08:34:00.257004 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:34:00.256983    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357\": container with ID starting with 0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357 not found: ID does not exist" containerID="0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357"
Jul 14 08:34:00.257075 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.257017    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357"} err="failed to get container status \"0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357\": rpc error: code = NotFound desc = could not find container \"0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357\": container with ID starting with 0cf6970ecab9b6c3aa25f52cfe03562b606942134ac529befef10a2e52eaf357 not found: ID does not exist"
Jul 14 08:34:00.268900 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.268870    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"]
Jul 14 08:34:00.274810 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.274784    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/sub-test-model-b9c837-kserve-6b994c8c9-4g8kq"]
Jul 14 08:34:00.985893 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.985856    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be6687d5-8092-4ebe-9b5f-4357fa1b3428" path="/var/lib/kubelet/pods/be6687d5-8092-4ebe-9b5f-4357fa1b3428/volumes"
Jul 14 08:34:00.986456 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.986434    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" path="/var/lib/kubelet/pods/d58792ac-2ae0-492f-b0c4-fe7ca93d5da0/volumes"
Jul 14 08:34:00.986738 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.986723    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"]
Jul 14 08:34:00.987094 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.987082    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" containerName="main"
Jul 14 08:34:00.987129 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.987096    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" containerName="main"
Jul 14 08:34:00.987129 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.987114    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be6687d5-8092-4ebe-9b5f-4357fa1b3428" containerName="main"
Jul 14 08:34:00.987129 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.987120    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6687d5-8092-4ebe-9b5f-4357fa1b3428" containerName="main"
Jul 14 08:34:00.987227 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.987184    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d58792ac-2ae0-492f-b0c4-fe7ca93d5da0" containerName="main"
Jul 14 08:34:00.987227 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.987192    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be6687d5-8092-4ebe-9b5f-4357fa1b3428" containerName="main"
Jul 14 08:34:00.991515 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.991497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:00.995692 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.995505    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"kube-root-ca.crt\""
Jul 14 08:34:00.996768 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.996747    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"rate-test-model-0324b2-kserve-self-signed-certs\""
Jul 14 08:34:00.997148 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.997123    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"default-dockercfg-zwclm\""
Jul 14 08:34:00.998353 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.998165    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0324b2\"/\"openshift-service-ca.crt\""
Jul 14 08:34:00.999983 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:00.999961    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"]
Jul 14 08:34:01.010767 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.010726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:34:01.080316 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.080279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-dshm\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.080316 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.080313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-model-cache\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.080537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.080392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-home\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.080537 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.080514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tls-certs\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.080603 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.080545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbp4m\" (UniqueName: \"kubernetes.io/projected/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-kube-api-access-zbp4m\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.080603 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.080573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tmp-dir\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.181946 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.181906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-home\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.182133 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.182000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tls-certs\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.182133 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.182026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbp4m\" (UniqueName: \"kubernetes.io/projected/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-kube-api-access-zbp4m\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.182133 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.182091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tmp-dir\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.182287 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.182150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-dshm\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.182287 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.182175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-model-cache\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.182432 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.182412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-home\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.182474 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.182458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tmp-dir\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.182545 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.182526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-model-cache\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.184435 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.184407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-dshm\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.184671 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.184654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tls-certs\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.192446 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.192420    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbp4m\" (UniqueName: \"kubernetes.io/projected/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-kube-api-access-zbp4m\") pod \"rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") " pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.304564 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.304463    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:01.446141 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:01.446117    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"]
Jul 14 08:34:01.448577 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:34:01.448549    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbbfeb3f_79cd_4652_93d7_545bdec85e4b.slice/crio-69a2d237b733fd76c2c8866233314155a611729385e1c142c9205eec943dde6b WatchSource:0}: Error finding container 69a2d237b733fd76c2c8866233314155a611729385e1c142c9205eec943dde6b: Status 404 returned error can't find the container with id 69a2d237b733fd76c2c8866233314155a611729385e1c142c9205eec943dde6b
Jul 14 08:34:02.260487 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:02.260445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5" event={"ID":"bbbfeb3f-79cd-4652-93d7-545bdec85e4b","Type":"ContainerStarted","Data":"7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7"}
Jul 14 08:34:02.260487 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:02.260493    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5" event={"ID":"bbbfeb3f-79cd-4652-93d7-545bdec85e4b","Type":"ContainerStarted","Data":"69a2d237b733fd76c2c8866233314155a611729385e1c142c9205eec943dde6b"}
Jul 14 08:34:02.279253 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:02.279201    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5" podStartSLOduration=2.279183184 podStartE2EDuration="2.279183184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:34:02.278245356 +0000 UTC m=+2637.857251698" watchObservedRunningTime="2026-07-14 08:34:02.279183184 +0000 UTC m=+2637.858189523"
Jul 14 08:34:11.305103 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:11.305073    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:11.305531 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:11.305119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:11.318178 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:11.318151    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:12.321747 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:12.321713    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:34:32.629028 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:32.628991    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:34:32.730347 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:32.730313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:34:35.582240 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.582210    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"]
Jul 14 08:34:35.585858 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.585833    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.589505 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.589473    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"default-dockercfg-b45wz\""
Jul 14 08:34:35.589505 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.589486    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"rate-test-model-b9c837-kserve-self-signed-certs\""
Jul 14 08:34:35.589723 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.589482    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"openshift-service-ca.crt\""
Jul 14 08:34:35.589723 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.589482    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9c837\"/\"kube-root-ca.crt\""
Jul 14 08:34:35.596612 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.596588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"]
Jul 14 08:34:35.619349 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.619311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:34:35.686404 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.686364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-model-cache\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.686404 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.686402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeade322-ddb4-4697-8134-f2298b6d7fbb-tls-certs\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.686645 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.686443    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-home\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.686645 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.686466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-tmp-dir\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.686645 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.686497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt5rk\" (UniqueName: \"kubernetes.io/projected/eeade322-ddb4-4697-8134-f2298b6d7fbb-kube-api-access-lt5rk\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.686645 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.686598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-dshm\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.787465 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-home\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.787613 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-tmp-dir\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.787613 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt5rk\" (UniqueName: \"kubernetes.io/projected/eeade322-ddb4-4697-8134-f2298b6d7fbb-kube-api-access-lt5rk\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.787613 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-dshm\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.787613 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-model-cache\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.787800 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeade322-ddb4-4697-8134-f2298b6d7fbb-tls-certs\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.787858 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-home\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.787912 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-tmp-dir\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.788075 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.787926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-model-cache\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.789927 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.789907    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-dshm\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.790359 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.790343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeade322-ddb4-4697-8134-f2298b6d7fbb-tls-certs\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.795559 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.795535    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt5rk\" (UniqueName: \"kubernetes.io/projected/eeade322-ddb4-4697-8134-f2298b6d7fbb-kube-api-access-lt5rk\") pod \"rate-test-model-b9c837-kserve-677999cd6c-jl4hg\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") " pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:35.896581 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:35.896483    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:36.035831 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:36.035807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"]
Jul 14 08:34:36.038586 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:34:36.038553    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeade322_ddb4_4697_8134_f2298b6d7fbb.slice/crio-225c7bec3001bc3456c8f0fc3edf46d9a3f93287720550990c694dd108162f6b WatchSource:0}: Error finding container 225c7bec3001bc3456c8f0fc3edf46d9a3f93287720550990c694dd108162f6b: Status 404 returned error can't find the container with id 225c7bec3001bc3456c8f0fc3edf46d9a3f93287720550990c694dd108162f6b
Jul 14 08:34:36.438333 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:36.438298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg" event={"ID":"eeade322-ddb4-4697-8134-f2298b6d7fbb","Type":"ContainerStarted","Data":"6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace"}
Jul 14 08:34:36.438526 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:36.438349    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg" event={"ID":"eeade322-ddb4-4697-8134-f2298b6d7fbb","Type":"ContainerStarted","Data":"225c7bec3001bc3456c8f0fc3edf46d9a3f93287720550990c694dd108162f6b"}
Jul 14 08:34:39.935046 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:39.934996    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:34:40.034329 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:40.034294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:34:45.896853 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:45.896812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:45.897392 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:45.896871    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:45.909730 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:45.909703    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:34:45.927779 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:45.927721    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg" podStartSLOduration=10.927703156 podStartE2EDuration="10.927703156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:34:36.454736156 +0000 UTC m=+2672.033742497" watchObservedRunningTime="2026-07-14 08:34:45.927703156 +0000 UTC m=+2681.506709494"
Jul 14 08:34:46.500327 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:34:46.500301    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:35:05.047912 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:05.047836    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:35:05.055818 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:05.055793    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbsmz_99e14a82-88d7-406f-8f8a-3bd65351cae7/ovn-acl-logging/0.log"
Jul 14 08:35:23.703824 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:23.703780    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"]
Jul 14 08:35:23.725319 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:23.725260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:35:24.460521 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:24.460487    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"]
Jul 14 08:35:24.478252 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:24.478221    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:35:25.432557 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.432505    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7345-140181609100720"]
Jul 14 08:35:25.437612 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.437577    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181609100720"
Jul 14 08:35:25.441110 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.441081    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-fdsqh\""
Jul 14 08:35:25.443980 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.443957    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181609100720"]
Jul 14 08:35:25.539659 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.539618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pss6t\" (UniqueName: \"kubernetes.io/projected/145b4ecc-cc68-44e5-a5cc-8d8308317fa0-kube-api-access-pss6t\") pod \"test-curl-7345-140181609100720\" (UID: \"145b4ecc-cc68-44e5-a5cc-8d8308317fa0\") " pod="openshift-ingress/test-curl-7345-140181609100720"
Jul 14 08:35:25.640643 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.640587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pss6t\" (UniqueName: \"kubernetes.io/projected/145b4ecc-cc68-44e5-a5cc-8d8308317fa0-kube-api-access-pss6t\") pod \"test-curl-7345-140181609100720\" (UID: \"145b4ecc-cc68-44e5-a5cc-8d8308317fa0\") " pod="openshift-ingress/test-curl-7345-140181609100720"
Jul 14 08:35:25.648924 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.648890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pss6t\" (UniqueName: \"kubernetes.io/projected/145b4ecc-cc68-44e5-a5cc-8d8308317fa0-kube-api-access-pss6t\") pod \"test-curl-7345-140181609100720\" (UID: \"145b4ecc-cc68-44e5-a5cc-8d8308317fa0\") " pod="openshift-ingress/test-curl-7345-140181609100720"
Jul 14 08:35:25.750643 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.750592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181609100720"
Jul 14 08:35:25.883534 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.883504    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181609100720"]
Jul 14 08:35:25.885384 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:35:25.885354    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod145b4ecc_cc68_44e5_a5cc_8d8308317fa0.slice/crio-95a348630bbef02acfd7cb6e9ecb4753fca0674aef4639aa091b655b1095e106 WatchSource:0}: Error finding container 95a348630bbef02acfd7cb6e9ecb4753fca0674aef4639aa091b655b1095e106: Status 404 returned error can't find the container with id 95a348630bbef02acfd7cb6e9ecb4753fca0674aef4639aa091b655b1095e106
Jul 14 08:35:25.886688 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:25.886669    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 08:35:26.697670 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:26.697638    2579 generic.go:356] "Generic (PLEG): container finished" podID="145b4ecc-cc68-44e5-a5cc-8d8308317fa0" containerID="77cd8a62249628048c61632d0bf79fff47b094279efe849bf339e725c54d1818" exitCode=0
Jul 14 08:35:26.698026 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:26.697721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181609100720" event={"ID":"145b4ecc-cc68-44e5-a5cc-8d8308317fa0","Type":"ContainerDied","Data":"77cd8a62249628048c61632d0bf79fff47b094279efe849bf339e725c54d1818"}
Jul 14 08:35:26.698026 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:26.697760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181609100720" event={"ID":"145b4ecc-cc68-44e5-a5cc-8d8308317fa0","Type":"ContainerStarted","Data":"95a348630bbef02acfd7cb6e9ecb4753fca0674aef4639aa091b655b1095e106"}
Jul 14 08:35:27.846650 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:27.846615    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181609100720"
Jul 14 08:35:27.866894 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:27.866869    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7345-140181609100720_145b4ecc-cc68-44e5-a5cc-8d8308317fa0/test-curl-7345-140181609100720/0.log"
Jul 14 08:35:27.891580 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:27.891545    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7345-140181609100720"]
Jul 14 08:35:27.895295 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:27.895269    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7345-140181609100720"]
Jul 14 08:35:27.959372 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:27.959277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pss6t\" (UniqueName: \"kubernetes.io/projected/145b4ecc-cc68-44e5-a5cc-8d8308317fa0-kube-api-access-pss6t\") pod \"145b4ecc-cc68-44e5-a5cc-8d8308317fa0\" (UID: \"145b4ecc-cc68-44e5-a5cc-8d8308317fa0\") "
Jul 14 08:35:27.961548 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:27.961516    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/145b4ecc-cc68-44e5-a5cc-8d8308317fa0-kube-api-access-pss6t" (OuterVolumeSpecName: "kube-api-access-pss6t") pod "145b4ecc-cc68-44e5-a5cc-8d8308317fa0" (UID: "145b4ecc-cc68-44e5-a5cc-8d8308317fa0"). InnerVolumeSpecName "kube-api-access-pss6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:28.060355 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:28.060317    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pss6t\" (UniqueName: \"kubernetes.io/projected/145b4ecc-cc68-44e5-a5cc-8d8308317fa0-kube-api-access-pss6t\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:28.708765 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:28.708735    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181609100720"
Jul 14 08:35:28.708765 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:28.708758    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95a348630bbef02acfd7cb6e9ecb4753fca0674aef4639aa091b655b1095e106"
Jul 14 08:35:28.719119 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:35:28.719092    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7345-140181609100720\" is forbidden: User \"system:node:ip-10-0-131-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-131-251.ec2.internal' and this object" podUID="145b4ecc-cc68-44e5-a5cc-8d8308317fa0" pod="openshift-ingress/test-curl-7345-140181609100720"
Jul 14 08:35:28.985457 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:28.985423    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="145b4ecc-cc68-44e5-a5cc-8d8308317fa0" path="/var/lib/kubelet/pods/145b4ecc-cc68-44e5-a5cc-8d8308317fa0/volumes"
Jul 14 08:35:36.881271 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:36.881170    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:36.881675 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:36.881508    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145b4ecc-cc68-44e5-a5cc-8d8308317fa0" containerName="test-curl-7345-140181609100720"
Jul 14 08:35:36.881675 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:36.881521    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="145b4ecc-cc68-44e5-a5cc-8d8308317fa0" containerName="test-curl-7345-140181609100720"
Jul 14 08:35:36.881675 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:36.881584    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="145b4ecc-cc68-44e5-a5cc-8d8308317fa0" containerName="test-curl-7345-140181609100720"
Jul 14 08:35:36.884847 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:36.884828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:36.888131 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:36.888097    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-fdsqh\""
Jul 14 08:35:36.890635 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:36.890609    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:37.043429 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:37.043383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw277\" (UniqueName: \"kubernetes.io/projected/41584fb1-ebcb-4dee-abef-8a9fb7bb1979-kube-api-access-sw277\") pod \"test-curl-7345-140181608592704\" (UID: \"41584fb1-ebcb-4dee-abef-8a9fb7bb1979\") " pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:37.144726 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:37.144649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw277\" (UniqueName: \"kubernetes.io/projected/41584fb1-ebcb-4dee-abef-8a9fb7bb1979-kube-api-access-sw277\") pod \"test-curl-7345-140181608592704\" (UID: \"41584fb1-ebcb-4dee-abef-8a9fb7bb1979\") " pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:37.153784 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:37.153750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw277\" (UniqueName: \"kubernetes.io/projected/41584fb1-ebcb-4dee-abef-8a9fb7bb1979-kube-api-access-sw277\") pod \"test-curl-7345-140181608592704\" (UID: \"41584fb1-ebcb-4dee-abef-8a9fb7bb1979\") " pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:37.195929 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:37.195886    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:37.332457 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:37.332431    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:37.335525 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:35:37.335493    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41584fb1_ebcb_4dee_abef_8a9fb7bb1979.slice/crio-70d2cfd859cc6a6fc998a3e68bbba86fb8f835db9243ba4044ebd9242b387a91 WatchSource:0}: Error finding container 70d2cfd859cc6a6fc998a3e68bbba86fb8f835db9243ba4044ebd9242b387a91: Status 404 returned error can't find the container with id 70d2cfd859cc6a6fc998a3e68bbba86fb8f835db9243ba4044ebd9242b387a91
Jul 14 08:35:37.757919 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:37.757885    2579 generic.go:356] "Generic (PLEG): container finished" podID="41584fb1-ebcb-4dee-abef-8a9fb7bb1979" containerID="81da318c14d666ed0113c1a1b663dd13497c013862a90a3642330478b27d1455" exitCode=0
Jul 14 08:35:37.758135 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:37.757970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181608592704" event={"ID":"41584fb1-ebcb-4dee-abef-8a9fb7bb1979","Type":"ContainerDied","Data":"81da318c14d666ed0113c1a1b663dd13497c013862a90a3642330478b27d1455"}
Jul 14 08:35:37.758135 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:37.758017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181608592704" event={"ID":"41584fb1-ebcb-4dee-abef-8a9fb7bb1979","Type":"ContainerStarted","Data":"70d2cfd859cc6a6fc998a3e68bbba86fb8f835db9243ba4044ebd9242b387a91"}
Jul 14 08:35:38.724666 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:38.724622    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5" podUID="bbbfeb3f-79cd-4652-93d7-545bdec85e4b" containerName="main" containerID="cri-o://7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7" gracePeriod=45
Jul 14 08:35:38.906395 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:38.906365    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:38.928811 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:38.928771    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7345-140181608592704_41584fb1-ebcb-4dee-abef-8a9fb7bb1979/test-curl-7345-140181608592704/0.log"
Jul 14 08:35:38.950716 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:38.950682    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:38.954052 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:38.954008    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:38.975901 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:38.975834    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:35:39.061758 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.061718    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-model-cache\") pod \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") "
Jul 14 08:35:39.061758 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.061764    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-dshm\") pod \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") "
Jul 14 08:35:39.062017 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.061818    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-home\") pod \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") "
Jul 14 08:35:39.062017 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.061839    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw277\" (UniqueName: \"kubernetes.io/projected/41584fb1-ebcb-4dee-abef-8a9fb7bb1979-kube-api-access-sw277\") pod \"41584fb1-ebcb-4dee-abef-8a9fb7bb1979\" (UID: \"41584fb1-ebcb-4dee-abef-8a9fb7bb1979\") "
Jul 14 08:35:39.062017 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.061895    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tmp-dir\") pod \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") "
Jul 14 08:35:39.062017 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.061971    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tls-certs\") pod \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") "
Jul 14 08:35:39.062017 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.062009    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbp4m\" (UniqueName: \"kubernetes.io/projected/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-kube-api-access-zbp4m\") pod \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\" (UID: \"bbbfeb3f-79cd-4652-93d7-545bdec85e4b\") "
Jul 14 08:35:39.062319 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.062078    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "bbbfeb3f-79cd-4652-93d7-545bdec85e4b" (UID: "bbbfeb3f-79cd-4652-93d7-545bdec85e4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:35:39.062319 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.062188    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-home" (OuterVolumeSpecName: "home") pod "bbbfeb3f-79cd-4652-93d7-545bdec85e4b" (UID: "bbbfeb3f-79cd-4652-93d7-545bdec85e4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:35:39.062319 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.062215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bbbfeb3f-79cd-4652-93d7-545bdec85e4b" (UID: "bbbfeb3f-79cd-4652-93d7-545bdec85e4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:35:39.062529 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.062506    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.062705 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.062682    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.062815 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.062710    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.064246 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.064219    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bbbfeb3f-79cd-4652-93d7-545bdec85e4b" (UID: "bbbfeb3f-79cd-4652-93d7-545bdec85e4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:35:39.064345 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.064262    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-dshm" (OuterVolumeSpecName: "dshm") pod "bbbfeb3f-79cd-4652-93d7-545bdec85e4b" (UID: "bbbfeb3f-79cd-4652-93d7-545bdec85e4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:35:39.064345 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.064273    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41584fb1-ebcb-4dee-abef-8a9fb7bb1979-kube-api-access-sw277" (OuterVolumeSpecName: "kube-api-access-sw277") pod "41584fb1-ebcb-4dee-abef-8a9fb7bb1979" (UID: "41584fb1-ebcb-4dee-abef-8a9fb7bb1979"). InnerVolumeSpecName "kube-api-access-sw277". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:39.064425 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.064360    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-kube-api-access-zbp4m" (OuterVolumeSpecName: "kube-api-access-zbp4m") pod "bbbfeb3f-79cd-4652-93d7-545bdec85e4b" (UID: "bbbfeb3f-79cd-4652-93d7-545bdec85e4b"). InnerVolumeSpecName "kube-api-access-zbp4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:39.074631 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.074597    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:39.075005 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.074988    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbfeb3f-79cd-4652-93d7-545bdec85e4b" containerName="main"
Jul 14 08:35:39.075116 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.075007    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbfeb3f-79cd-4652-93d7-545bdec85e4b" containerName="main"
Jul 14 08:35:39.075116 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.075025    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41584fb1-ebcb-4dee-abef-8a9fb7bb1979" containerName="test-curl-7345-140181608592704"
Jul 14 08:35:39.075116 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.075051    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="41584fb1-ebcb-4dee-abef-8a9fb7bb1979" containerName="test-curl-7345-140181608592704"
Jul 14 08:35:39.075268 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.075151    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="41584fb1-ebcb-4dee-abef-8a9fb7bb1979" containerName="test-curl-7345-140181608592704"
Jul 14 08:35:39.075268 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.075167    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbbfeb3f-79cd-4652-93d7-545bdec85e4b" containerName="main"
Jul 14 08:35:39.078388 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.078365    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:39.084610 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.084577    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:39.163947 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.163919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxrnq\" (UniqueName: \"kubernetes.io/projected/6bf3b0b6-b56b-4ead-a6b3-960f8a943c17-kube-api-access-fxrnq\") pod \"test-curl-7345-140181608592704\" (UID: \"6bf3b0b6-b56b-4ead-a6b3-960f8a943c17\") " pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:39.164101 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.164019    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw277\" (UniqueName: \"kubernetes.io/projected/41584fb1-ebcb-4dee-abef-8a9fb7bb1979-kube-api-access-sw277\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.164101 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.164056    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.164101 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.164067    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbp4m\" (UniqueName: \"kubernetes.io/projected/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-kube-api-access-zbp4m\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.164101 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.164076    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbbfeb3f-79cd-4652-93d7-545bdec85e4b-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.265390 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.265290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxrnq\" (UniqueName: \"kubernetes.io/projected/6bf3b0b6-b56b-4ead-a6b3-960f8a943c17-kube-api-access-fxrnq\") pod \"test-curl-7345-140181608592704\" (UID: \"6bf3b0b6-b56b-4ead-a6b3-960f8a943c17\") " pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:39.274937 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.274905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxrnq\" (UniqueName: \"kubernetes.io/projected/6bf3b0b6-b56b-4ead-a6b3-960f8a943c17-kube-api-access-fxrnq\") pod \"test-curl-7345-140181608592704\" (UID: \"6bf3b0b6-b56b-4ead-a6b3-960f8a943c17\") " pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:39.389022 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.388986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:39.481957 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.481913    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg" podUID="eeade322-ddb4-4697-8134-f2298b6d7fbb" containerName="main" containerID="cri-o://6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace" gracePeriod=45
Jul 14 08:35:39.528542 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.528465    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:39.540075 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:35:39.540023    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf3b0b6_b56b_4ead_a6b3_960f8a943c17.slice/crio-7f64b4986b9fd89bd35a35194ccad8c89358b54c894cf57481355737cc89bb35 WatchSource:0}: Error finding container 7f64b4986b9fd89bd35a35194ccad8c89358b54c894cf57481355737cc89bb35: Status 404 returned error can't find the container with id 7f64b4986b9fd89bd35a35194ccad8c89358b54c894cf57481355737cc89bb35
Jul 14 08:35:39.727277 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.727250    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:35:39.770449 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.770414    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181608592704" event={"ID":"6bf3b0b6-b56b-4ead-a6b3-960f8a943c17","Type":"ContainerStarted","Data":"7f64b4986b9fd89bd35a35194ccad8c89358b54c894cf57481355737cc89bb35"}
Jul 14 08:35:39.771768 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.771748    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:39.771912 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.771794    2579 scope.go:117] "RemoveContainer" containerID="81da318c14d666ed0113c1a1b663dd13497c013862a90a3642330478b27d1455"
Jul 14 08:35:39.773346 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.773075    2579 generic.go:356] "Generic (PLEG): container finished" podID="bbbfeb3f-79cd-4652-93d7-545bdec85e4b" containerID="7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7" exitCode=0
Jul 14 08:35:39.773346 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.773119    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"
Jul 14 08:35:39.773346 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.773166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5" event={"ID":"bbbfeb3f-79cd-4652-93d7-545bdec85e4b","Type":"ContainerDied","Data":"7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7"}
Jul 14 08:35:39.773346 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.773203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5" event={"ID":"bbbfeb3f-79cd-4652-93d7-545bdec85e4b","Type":"ContainerDied","Data":"69a2d237b733fd76c2c8866233314155a611729385e1c142c9205eec943dde6b"}
Jul 14 08:35:39.774876 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.774849    2579 generic.go:356] "Generic (PLEG): container finished" podID="eeade322-ddb4-4697-8134-f2298b6d7fbb" containerID="6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace" exitCode=0
Jul 14 08:35:39.775003 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.774892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg" event={"ID":"eeade322-ddb4-4697-8134-f2298b6d7fbb","Type":"ContainerDied","Data":"6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace"}
Jul 14 08:35:39.775003 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.774904    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"
Jul 14 08:35:39.775151 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.774923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg" event={"ID":"eeade322-ddb4-4697-8134-f2298b6d7fbb","Type":"ContainerDied","Data":"225c7bec3001bc3456c8f0fc3edf46d9a3f93287720550990c694dd108162f6b"}
Jul 14 08:35:39.783142 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.783110    2579 scope.go:117] "RemoveContainer" containerID="7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7"
Jul 14 08:35:39.791849 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.791830    2579 scope.go:117] "RemoveContainer" containerID="7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7"
Jul 14 08:35:39.792162 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:35:39.792143    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7\": container with ID starting with 7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7 not found: ID does not exist" containerID="7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7"
Jul 14 08:35:39.792259 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.792176    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7"} err="failed to get container status \"7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7\": rpc error: code = NotFound desc = could not find container \"7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7\": container with ID starting with 7f1ac53e211d539fb28278da5982c95666cdca6d61763988a58246cadc0568f7 not found: ID does not exist"
Jul 14 08:35:39.792259 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.792200    2579 scope.go:117] "RemoveContainer" containerID="6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace"
Jul 14 08:35:39.798314 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.798286    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"]
Jul 14 08:35:39.800816 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.800797    2579 scope.go:117] "RemoveContainer" containerID="6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace"
Jul 14 08:35:39.801304 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:35:39.801285    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace\": container with ID starting with 6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace not found: ID does not exist" containerID="6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace"
Jul 14 08:35:39.801379 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.801313    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace"} err="failed to get container status \"6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace\": rpc error: code = NotFound desc = could not find container \"6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace\": container with ID starting with 6b494a9c251eb7745c91038bc36aa54b888adbd5557f4d71a5fa2798c50d9ace not found: ID does not exist"
Jul 14 08:35:39.802213 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.802196    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0324b2/rate-test-model-0324b2-kserve-7bcffcd6c-gt2b5"]
Jul 14 08:35:39.870787 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.870749    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-home\") pod \"eeade322-ddb4-4697-8134-f2298b6d7fbb\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") "
Jul 14 08:35:39.870945 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.870820    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-dshm\") pod \"eeade322-ddb4-4697-8134-f2298b6d7fbb\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") "
Jul 14 08:35:39.870945 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.870849    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt5rk\" (UniqueName: \"kubernetes.io/projected/eeade322-ddb4-4697-8134-f2298b6d7fbb-kube-api-access-lt5rk\") pod \"eeade322-ddb4-4697-8134-f2298b6d7fbb\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") "
Jul 14 08:35:39.870945 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.870901    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-tmp-dir\") pod \"eeade322-ddb4-4697-8134-f2298b6d7fbb\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") "
Jul 14 08:35:39.871168 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.871014    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-model-cache\") pod \"eeade322-ddb4-4697-8134-f2298b6d7fbb\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") "
Jul 14 08:35:39.871168 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.871091    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeade322-ddb4-4697-8134-f2298b6d7fbb-tls-certs\") pod \"eeade322-ddb4-4697-8134-f2298b6d7fbb\" (UID: \"eeade322-ddb4-4697-8134-f2298b6d7fbb\") "
Jul 14 08:35:39.871168 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.871088    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-home" (OuterVolumeSpecName: "home") pod "eeade322-ddb4-4697-8134-f2298b6d7fbb" (UID: "eeade322-ddb4-4697-8134-f2298b6d7fbb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:35:39.871323 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.871252    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-model-cache" (OuterVolumeSpecName: "model-cache") pod "eeade322-ddb4-4697-8134-f2298b6d7fbb" (UID: "eeade322-ddb4-4697-8134-f2298b6d7fbb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:35:39.871323 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.871267    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eeade322-ddb4-4697-8134-f2298b6d7fbb" (UID: "eeade322-ddb4-4697-8134-f2298b6d7fbb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:35:39.871428 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.871407    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-tmp-dir\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.871428 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.871429    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-model-cache\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.871584 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.871442    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-home\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.873076 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.873048    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-dshm" (OuterVolumeSpecName: "dshm") pod "eeade322-ddb4-4697-8134-f2298b6d7fbb" (UID: "eeade322-ddb4-4697-8134-f2298b6d7fbb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 08:35:39.873158 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.873077    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeade322-ddb4-4697-8134-f2298b6d7fbb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eeade322-ddb4-4697-8134-f2298b6d7fbb" (UID: "eeade322-ddb4-4697-8134-f2298b6d7fbb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 08:35:39.873158 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.873097    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeade322-ddb4-4697-8134-f2298b6d7fbb-kube-api-access-lt5rk" (OuterVolumeSpecName: "kube-api-access-lt5rk") pod "eeade322-ddb4-4697-8134-f2298b6d7fbb" (UID: "eeade322-ddb4-4697-8134-f2298b6d7fbb"). InnerVolumeSpecName "kube-api-access-lt5rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:39.972637 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.972603    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeade322-ddb4-4697-8134-f2298b6d7fbb-dshm\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.972637 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.972631    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt5rk\" (UniqueName: \"kubernetes.io/projected/eeade322-ddb4-4697-8134-f2298b6d7fbb-kube-api-access-lt5rk\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:39.972637 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:39.972641    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeade322-ddb4-4697-8134-f2298b6d7fbb-tls-certs\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:40.097429 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:40.097392    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"]
Jul 14 08:35:40.101915 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:40.101883    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b9c837/rate-test-model-b9c837-kserve-677999cd6c-jl4hg"]
Jul 14 08:35:40.781113 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:40.781080    2579 generic.go:356] "Generic (PLEG): container finished" podID="6bf3b0b6-b56b-4ead-a6b3-960f8a943c17" containerID="a783513f3f8922fc401dab0450643cefe9d2716fc52379e7738a318812ff3da4" exitCode=0
Jul 14 08:35:40.781563 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:40.781179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7345-140181608592704" event={"ID":"6bf3b0b6-b56b-4ead-a6b3-960f8a943c17","Type":"ContainerDied","Data":"a783513f3f8922fc401dab0450643cefe9d2716fc52379e7738a318812ff3da4"}
Jul 14 08:35:40.985421 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:40.985384    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41584fb1-ebcb-4dee-abef-8a9fb7bb1979" path="/var/lib/kubelet/pods/41584fb1-ebcb-4dee-abef-8a9fb7bb1979/volumes"
Jul 14 08:35:40.985790 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:40.985777    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbbfeb3f-79cd-4652-93d7-545bdec85e4b" path="/var/lib/kubelet/pods/bbbfeb3f-79cd-4652-93d7-545bdec85e4b/volumes"
Jul 14 08:35:40.986138 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:40.986125    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeade322-ddb4-4697-8134-f2298b6d7fbb" path="/var/lib/kubelet/pods/eeade322-ddb4-4697-8134-f2298b6d7fbb/volumes"
Jul 14 08:35:41.927958 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:41.927933    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:41.948322 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:41.948296    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7345-140181608592704_6bf3b0b6-b56b-4ead-a6b3-960f8a943c17/test-curl-7345-140181608592704/0.log"
Jul 14 08:35:41.977633 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:41.977600    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:41.983412 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:41.983384    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7345-140181608592704"]
Jul 14 08:35:42.091214 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.091097    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxrnq\" (UniqueName: \"kubernetes.io/projected/6bf3b0b6-b56b-4ead-a6b3-960f8a943c17-kube-api-access-fxrnq\") pod \"6bf3b0b6-b56b-4ead-a6b3-960f8a943c17\" (UID: \"6bf3b0b6-b56b-4ead-a6b3-960f8a943c17\") "
Jul 14 08:35:42.093265 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.093230    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf3b0b6-b56b-4ead-a6b3-960f8a943c17-kube-api-access-fxrnq" (OuterVolumeSpecName: "kube-api-access-fxrnq") pod "6bf3b0b6-b56b-4ead-a6b3-960f8a943c17" (UID: "6bf3b0b6-b56b-4ead-a6b3-960f8a943c17"). InnerVolumeSpecName "kube-api-access-fxrnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 08:35:42.179944 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.179903    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"]
Jul 14 08:35:42.180373 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.180354    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf3b0b6-b56b-4ead-a6b3-960f8a943c17" containerName="test-curl-7345-140181608592704"
Jul 14 08:35:42.180468 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.180376    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf3b0b6-b56b-4ead-a6b3-960f8a943c17" containerName="test-curl-7345-140181608592704"
Jul 14 08:35:42.180468 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.180399    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeade322-ddb4-4697-8134-f2298b6d7fbb" containerName="main"
Jul 14 08:35:42.180468 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.180409    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeade322-ddb4-4697-8134-f2298b6d7fbb" containerName="main"
Jul 14 08:35:42.180619 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.180492    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf3b0b6-b56b-4ead-a6b3-960f8a943c17" containerName="test-curl-7345-140181608592704"
Jul 14 08:35:42.180619 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.180507    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeade322-ddb4-4697-8134-f2298b6d7fbb" containerName="main"
Jul 14 08:35:42.183226 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.183202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"
Jul 14 08:35:42.185804 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.185780    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:35:42.185949 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.185811    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:35:42.190473 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.190449    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"]
Jul 14 08:35:42.191844 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.191821    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxrnq\" (UniqueName: \"kubernetes.io/projected/6bf3b0b6-b56b-4ead-a6b3-960f8a943c17-kube-api-access-fxrnq\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:42.293284 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.293236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0878ec47-f7f6-4250-9edf-aa4118fda584-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx\" (UID: \"0878ec47-f7f6-4250-9edf-aa4118fda584\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"
Jul 14 08:35:42.394442 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.394346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0878ec47-f7f6-4250-9edf-aa4118fda584-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx\" (UID: \"0878ec47-f7f6-4250-9edf-aa4118fda584\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"
Jul 14 08:35:42.395084 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.395031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0878ec47-f7f6-4250-9edf-aa4118fda584-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx\" (UID: \"0878ec47-f7f6-4250-9edf-aa4118fda584\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"
Jul 14 08:35:42.496247 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.496196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"
Jul 14 08:35:42.628928 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.628902    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"]
Jul 14 08:35:42.630715 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:35:42.630686    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0878ec47_f7f6_4250_9edf_aa4118fda584.slice/crio-5e0f73d6b8b3c836d58a9f8717a489d709dff68ff6935056799c584a07ae3fd5 WatchSource:0}: Error finding container 5e0f73d6b8b3c836d58a9f8717a489d709dff68ff6935056799c584a07ae3fd5: Status 404 returned error can't find the container with id 5e0f73d6b8b3c836d58a9f8717a489d709dff68ff6935056799c584a07ae3fd5
Jul 14 08:35:42.693595 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.693561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:35:42.796523 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.796496    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:42.796681 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.796537    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f64b4986b9fd89bd35a35194ccad8c89358b54c894cf57481355737cc89bb35"
Jul 14 08:35:42.797900 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.797868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx" event={"ID":"0878ec47-f7f6-4250-9edf-aa4118fda584","Type":"ContainerStarted","Data":"5e0f73d6b8b3c836d58a9f8717a489d709dff68ff6935056799c584a07ae3fd5"}
Jul 14 08:35:42.805426 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.805403    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:35:42.807049 ip-10-0-131-251 kubenswrapper[2579]: E0714 08:35:42.807017    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7345-140181608592704\" is forbidden: User \"system:node:ip-10-0-131-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-131-251.ec2.internal' and this object" podUID="6bf3b0b6-b56b-4ead-a6b3-960f8a943c17" pod="openshift-ingress/test-curl-7345-140181608592704"
Jul 14 08:35:42.986073 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:42.986027    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bf3b0b6-b56b-4ead-a6b3-960f8a943c17" path="/var/lib/kubelet/pods/6bf3b0b6-b56b-4ead-a6b3-960f8a943c17/volumes"
Jul 14 08:35:43.805469 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:43.805439    2579 generic.go:356] "Generic (PLEG): container finished" podID="0878ec47-f7f6-4250-9edf-aa4118fda584" containerID="8150ff96ce4f3d86c4831cc7bd876a28755da510b72c2197876beffeaad574b3" exitCode=0
Jul 14 08:35:43.805655 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:43.805527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx" event={"ID":"0878ec47-f7f6-4250-9edf-aa4118fda584","Type":"ContainerDied","Data":"8150ff96ce4f3d86c4831cc7bd876a28755da510b72c2197876beffeaad574b3"}
Jul 14 08:35:44.938341 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:44.938316    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"
Jul 14 08:35:45.122232 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:45.122141    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0878ec47-f7f6-4250-9edf-aa4118fda584-maas-api-service-ca\") pod \"0878ec47-f7f6-4250-9edf-aa4118fda584\" (UID: \"0878ec47-f7f6-4250-9edf-aa4118fda584\") "
Jul 14 08:35:45.122534 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:45.122514    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0878ec47-f7f6-4250-9edf-aa4118fda584-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0878ec47-f7f6-4250-9edf-aa4118fda584" (UID: "0878ec47-f7f6-4250-9edf-aa4118fda584"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:35:45.222874 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:45.222837    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0878ec47-f7f6-4250-9edf-aa4118fda584-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:35:45.816709 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:45.816679    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx"
Jul 14 08:35:45.816889 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:45.816715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx" event={"ID":"0878ec47-f7f6-4250-9edf-aa4118fda584","Type":"ContainerDied","Data":"5e0f73d6b8b3c836d58a9f8717a489d709dff68ff6935056799c584a07ae3fd5"}
Jul 14 08:35:45.816889 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:45.816798    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e0f73d6b8b3c836d58a9f8717a489d709dff68ff6935056799c584a07ae3fd5"
Jul 14 08:35:52.750076 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:52.750030    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"]
Jul 14 08:35:52.750790 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:52.750753    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:35:52.753704 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:52.753680    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0324b2-29733630-szd9r"]
Jul 14 08:35:52.991257 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:52.991219    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c458858-0154-4050-ad56-3758159fad18" path="/var/lib/kubelet/pods/4c458858-0154-4050-ad56-3758159fad18/volumes"
Jul 14 08:35:57.282831 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:35:57.282797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:03.408578 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:03.408510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:04.021689 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:04.021652    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:05.239797 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:05.239765    2579 scope.go:117] "RemoveContainer" containerID="6c7c6dcda91380c117ed668ab6b5633db4942515f1cc1d6f010e98d159fb6a48"
Jul 14 08:36:08.019013 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.018978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:08.274917 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.274810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:08.425931 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.425898    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"]
Jul 14 08:36:08.426288 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.426275    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0878ec47-f7f6-4250-9edf-aa4118fda584" containerName="revoke-keys"
Jul 14 08:36:08.426340 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.426289    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0878ec47-f7f6-4250-9edf-aa4118fda584" containerName="revoke-keys"
Jul 14 08:36:08.426380 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.426340    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0878ec47-f7f6-4250-9edf-aa4118fda584" containerName="revoke-keys"
Jul 14 08:36:08.431207 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.431188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"
Jul 14 08:36:08.434155 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.434124    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fvtf7\""
Jul 14 08:36:08.435016 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.434988    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 08:36:08.437328 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.437297    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"]
Jul 14 08:36:08.522975 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.522934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d97d6d0-d601-473c-97b8-5d5d12072bb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv\" (UID: \"4d97d6d0-d601-473c-97b8-5d5d12072bb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"
Jul 14 08:36:08.623918 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.623818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d97d6d0-d601-473c-97b8-5d5d12072bb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv\" (UID: \"4d97d6d0-d601-473c-97b8-5d5d12072bb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"
Jul 14 08:36:08.624446 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.624428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d97d6d0-d601-473c-97b8-5d5d12072bb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv\" (UID: \"4d97d6d0-d601-473c-97b8-5d5d12072bb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"
Jul 14 08:36:08.743163 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.743119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"
Jul 14 08:36:08.908860 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.908783    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"]
Jul 14 08:36:08.911849 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:36:08.911824    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d97d6d0_d601_473c_97b8_5d5d12072bb3.slice/crio-277f5aecd53fb8f7c2a3f73fa819db30d8a865ed1f60bcb57575230a884c495f WatchSource:0}: Error finding container 277f5aecd53fb8f7c2a3f73fa819db30d8a865ed1f60bcb57575230a884c495f: Status 404 returned error can't find the container with id 277f5aecd53fb8f7c2a3f73fa819db30d8a865ed1f60bcb57575230a884c495f
Jul 14 08:36:08.938720 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.938689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv" event={"ID":"4d97d6d0-d601-473c-97b8-5d5d12072bb3","Type":"ContainerStarted","Data":"277f5aecd53fb8f7c2a3f73fa819db30d8a865ed1f60bcb57575230a884c495f"}
Jul 14 08:36:08.943358 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:08.943330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:09.044174 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:09.044139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:09.944707 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:09.944671    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d97d6d0-d601-473c-97b8-5d5d12072bb3" containerID="b4756d72ab9546d30e289b22b17383df45444e2c61d63c397aaf553e7266a35f" exitCode=0
Jul 14 08:36:09.944888 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:09.944759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv" event={"ID":"4d97d6d0-d601-473c-97b8-5d5d12072bb3","Type":"ContainerDied","Data":"b4756d72ab9546d30e289b22b17383df45444e2c61d63c397aaf553e7266a35f"}
Jul 14 08:36:11.081153 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:11.081122    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"
Jul 14 08:36:11.143149 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:11.143113    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d97d6d0-d601-473c-97b8-5d5d12072bb3-maas-api-service-ca\") pod \"4d97d6d0-d601-473c-97b8-5d5d12072bb3\" (UID: \"4d97d6d0-d601-473c-97b8-5d5d12072bb3\") "
Jul 14 08:36:11.143480 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:11.143459    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d97d6d0-d601-473c-97b8-5d5d12072bb3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d97d6d0-d601-473c-97b8-5d5d12072bb3" (UID: "4d97d6d0-d601-473c-97b8-5d5d12072bb3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 08:36:11.244287 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:11.244252    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d97d6d0-d601-473c-97b8-5d5d12072bb3-maas-api-service-ca\") on node \"ip-10-0-131-251.ec2.internal\" DevicePath \"\""
Jul 14 08:36:11.959211 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:11.959184    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv"
Jul 14 08:36:11.959211 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:11.959197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv" event={"ID":"4d97d6d0-d601-473c-97b8-5d5d12072bb3","Type":"ContainerDied","Data":"277f5aecd53fb8f7c2a3f73fa819db30d8a865ed1f60bcb57575230a884c495f"}
Jul 14 08:36:11.959482 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:11.959257    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="277f5aecd53fb8f7c2a3f73fa819db30d8a865ed1f60bcb57575230a884c495f"
Jul 14 08:36:19.088902 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:19.088865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:19.109726 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:19.109686    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"]
Jul 14 08:36:19.114120 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:19.114091    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b9c837-29733630-md72t"]
Jul 14 08:36:20.984310 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:20.984274    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f6fcf68-80d6-4cda-9f71-b01183575b15" path="/var/lib/kubelet/pods/3f6fcf68-80d6-4cda-9f71-b01183575b15/volumes"
Jul 14 08:36:23.511502 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:23.511470    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:24.749101 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:24.749063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:29.630325 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:29.630240    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:29.729986 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:29.729953    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:34.229350 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:34.229318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:34.470484 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:34.470448    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:39.757329 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:39.757295    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bnghd_0869c527-08bb-47f0-8364-68fe17acf08b/manager/0.log"
Jul 14 08:36:40.650081 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:40.650022    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-r66q8_3dfd42c7-5169-4300-afb4-0855b1cb78ed/copy-manifests/0.log"
Jul 14 08:36:40.663165 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:40.663133    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-r66q8_3dfd42c7-5169-4300-afb4-0855b1cb78ed/manager/0.log"
Jul 14 08:36:41.157955 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:41.157927    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733600-pvl92_c47793f1-bc3f-4820-bdc5-100262a81c83/cleanup/0.log"
Jul 14 08:36:41.279229 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:41.279203    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733615-4zpbl_bcad68c7-e3d0-4f78-a517-460bcd7705bc/cleanup/0.log"
Jul 14 08:36:41.393414 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:41.393388    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733630-zrhh4_8ebf9703-06ea-4dfc-b4a4-12a054c0cccb/cleanup/0.log"
Jul 14 08:36:41.511444 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:41.511416    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-b1c5cd00-fw6p7_b7d508b8-ef21-4306-b70f-513b131edffe/revoke-keys/0.log"
Jul 14 08:36:41.626332 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:41.626306    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-c0f2014a-bl6p9_9e78ba99-7674-43f3-a2b2-5849018fb0d8/revoke-keys/0.log"
Jul 14 08:36:41.743646 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:41.743619    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-2198a8-9lfsk_4b12394f-207f-4cb8-ae9e-514b106c08c7/revoke-keys/0.log"
Jul 14 08:36:41.855997 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:41.855919    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-1851fc-zgmq6_bea44707-ce08-4467-bfe4-0c21f9db9092/revoke-keys/0.log"
Jul 14 08:36:41.972793 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:41.972766    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-98e5d5c2-fx9zl_c1407df8-2cd6-4335-afc3-ab2037a99c93/revoke-keys/0.log"
Jul 14 08:36:42.087218 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:42.087190    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-5ae22d-n867k_7d082001-4d42-47a8-9c4f-899b8b80743d/revoke-keys/0.log"
Jul 14 08:36:42.196749 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:42.196676    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-bf6952-kkkwt_a7becd5c-0e90-4f40-872b-3caf249fb29b/revoke-keys/0.log"
Jul 14 08:36:42.318515 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:42.318483    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-b0c3e934-mwkqc_1b8b0e81-f98d-4246-9adc-a9c783a69aa5/revoke-keys/0.log"
Jul 14 08:36:42.431278 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:42.431252    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-9a0f7fb2-vbvz4_67b89d3a-9a8b-4144-b6f7-250d010f67b9/revoke-keys/0.log"
Jul 14 08:36:42.560504 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:42.560475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-b112a181-jhkcm_175b9c4a-7289-4203-a0d6-88b7040d83c1/revoke-keys/0.log"
Jul 14 08:36:42.686678 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:42.686650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-0324b2-h9lzx_0878ec47-f7f6-4250-9edf-aa4118fda584/revoke-keys/0.log"
Jul 14 08:36:42.800976 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:42.800947    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-b9c837-cwqpv_4d97d6d0-d601-473c-97b8-5d5d12072bb3/revoke-keys/0.log"
Jul 14 08:36:44.616074 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:44.616029    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-p7sqq_a6c4a6c2-59ad-496b-8129-e245d44698c3/kuadrant-console-plugin/0.log"
Jul 14 08:36:45.092993 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:45.092967    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6kmsj_9416fb35-8e8a-4cee-ac09-a27ad25c436b/manager/0.log"
Jul 14 08:36:45.718979 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:45.718952    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b677bd8c7-dxpbt_fbfdcab9-16fe-47c0-a4e8-507d52db0f08/kube-auth-proxy/0.log"
Jul 14 08:36:46.760419 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:46.760392    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-k8k5s_07763d46-c99c-4049-90a0-42407dd01d64/main/0.log"
Jul 14 08:36:47.100109 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:47.100010    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-w9tkl_f51ea579-305a-4544-90d6-5a1c0b63482c/main/0.log"
Jul 14 08:36:47.215184 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:47.215155    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-kxs22_15967a38-6372-4fe2-92d7-21833aaf9e7b/main/0.log"
Jul 14 08:36:51.750198 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.750153    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxkpt/must-gather-cvbtb"]
Jul 14 08:36:51.750667 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.750648    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d97d6d0-d601-473c-97b8-5d5d12072bb3" containerName="revoke-keys"
Jul 14 08:36:51.750737 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.750671    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d97d6d0-d601-473c-97b8-5d5d12072bb3" containerName="revoke-keys"
Jul 14 08:36:51.750794 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.750755    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d97d6d0-d601-473c-97b8-5d5d12072bb3" containerName="revoke-keys"
Jul 14 08:36:51.754064 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.754024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxkpt/must-gather-cvbtb"
Jul 14 08:36:51.757029 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.757006    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxkpt\"/\"default-dockercfg-t94tj\""
Jul 14 08:36:51.757167 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.757105    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxkpt\"/\"kube-root-ca.crt\""
Jul 14 08:36:51.758107 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.758090    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxkpt\"/\"openshift-service-ca.crt\""
Jul 14 08:36:51.762261 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.762239    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxkpt/must-gather-cvbtb"]
Jul 14 08:36:51.771869 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.771840    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:51.809350 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.809309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/530c4a76-efe1-41cb-a30e-59281c22f101-must-gather-output\") pod \"must-gather-cvbtb\" (UID: \"530c4a76-efe1-41cb-a30e-59281c22f101\") " pod="openshift-must-gather-wxkpt/must-gather-cvbtb"
Jul 14 08:36:51.809549 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.809360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvsjp\" (UniqueName: \"kubernetes.io/projected/530c4a76-efe1-41cb-a30e-59281c22f101-kube-api-access-gvsjp\") pod \"must-gather-cvbtb\" (UID: \"530c4a76-efe1-41cb-a30e-59281c22f101\") " pod="openshift-must-gather-wxkpt/must-gather-cvbtb"
Jul 14 08:36:51.910235 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.910191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/530c4a76-efe1-41cb-a30e-59281c22f101-must-gather-output\") pod \"must-gather-cvbtb\" (UID: \"530c4a76-efe1-41cb-a30e-59281c22f101\") " pod="openshift-must-gather-wxkpt/must-gather-cvbtb"
Jul 14 08:36:51.910235 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.910236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvsjp\" (UniqueName: \"kubernetes.io/projected/530c4a76-efe1-41cb-a30e-59281c22f101-kube-api-access-gvsjp\") pod \"must-gather-cvbtb\" (UID: \"530c4a76-efe1-41cb-a30e-59281c22f101\") " pod="openshift-must-gather-wxkpt/must-gather-cvbtb"
Jul 14 08:36:51.910597 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.910576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/530c4a76-efe1-41cb-a30e-59281c22f101-must-gather-output\") pod \"must-gather-cvbtb\" (UID: \"530c4a76-efe1-41cb-a30e-59281c22f101\") " pod="openshift-must-gather-wxkpt/must-gather-cvbtb"
Jul 14 08:36:51.921606 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:51.921572    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvsjp\" (UniqueName: \"kubernetes.io/projected/530c4a76-efe1-41cb-a30e-59281c22f101-kube-api-access-gvsjp\") pod \"must-gather-cvbtb\" (UID: \"530c4a76-efe1-41cb-a30e-59281c22f101\") " pod="openshift-must-gather-wxkpt/must-gather-cvbtb"
Jul 14 08:36:52.064927 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:52.064814    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxkpt/must-gather-cvbtb"
Jul 14 08:36:52.204000 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:52.203973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxkpt/must-gather-cvbtb"]
Jul 14 08:36:52.206461 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:36:52.206435    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod530c4a76_efe1_41cb_a30e_59281c22f101.slice/crio-b69c5c8f3802775e3dc7f579a2bbf4bc1f7c3677b26f65473ad18a950c312d91 WatchSource:0}: Error finding container b69c5c8f3802775e3dc7f579a2bbf4bc1f7c3677b26f65473ad18a950c312d91: Status 404 returned error can't find the container with id b69c5c8f3802775e3dc7f579a2bbf4bc1f7c3677b26f65473ad18a950c312d91
Jul 14 08:36:52.993267 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:52.993224    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log" limit=1024
Jul 14 08:36:53.178022 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:53.177973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/must-gather-cvbtb" event={"ID":"530c4a76-efe1-41cb-a30e-59281c22f101","Type":"ContainerStarted","Data":"434387438cdec5a0c7c14b45417cb09e36c01eb7812a4fe639a461f44d339527"}
Jul 14 08:36:53.178237 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:53.178056    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/must-gather-cvbtb" event={"ID":"530c4a76-efe1-41cb-a30e-59281c22f101","Type":"ContainerStarted","Data":"b69c5c8f3802775e3dc7f579a2bbf4bc1f7c3677b26f65473ad18a950c312d91"}
Jul 14 08:36:54.186736 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:54.186699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/must-gather-cvbtb" event={"ID":"530c4a76-efe1-41cb-a30e-59281c22f101","Type":"ContainerStarted","Data":"7a211b47a9ddf3b4f1550480fcc3f06e07cb993d802f247ee72ae2f4926501d8"}
Jul 14 08:36:54.206744 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:54.206688    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxkpt/must-gather-cvbtb" podStartSLOduration=2.371628353 podStartE2EDuration="3.206671296s" totalImagesPullingTime="835.042943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:36:54.203108039 +0000 UTC m=+2809.782114378" watchObservedRunningTime="2026-07-14 08:36:54.206671296 +0000 UTC m=+2809.785677635"
Jul 14 08:36:54.815588 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:54.815557    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hz6wd_3848661b-bad6-4761-9823-1d213895ab2a/global-pull-secret-syncer/0.log"
Jul 14 08:36:54.940339 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:54.940294    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8g8g8_bd3b864f-7006-4e05-a4f3-8dd121a27827/konnectivity-agent/0.log"
Jul 14 08:36:55.133467 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:36:55.133359    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-251.ec2.internal_45a109eebdae577f01fcda859fc8c61c/haproxy/0.log"
Jul 14 08:37:00.398324 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:00.398296    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-p7sqq_a6c4a6c2-59ad-496b-8129-e245d44698c3/kuadrant-console-plugin/0.log"
Jul 14 08:37:00.694379 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:00.694195    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6kmsj_9416fb35-8e8a-4cee-ac09-a27ad25c436b/manager/0.log"
Jul 14 08:37:02.702725 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:02.702653    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-prhv4_0d77122c-0812-4916-aea6-a2c325af973b/kube-state-metrics/0.log"
Jul 14 08:37:02.724273 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:02.724189    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-prhv4_0d77122c-0812-4916-aea6-a2c325af973b/kube-rbac-proxy-main/0.log"
Jul 14 08:37:02.746781 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:02.746752    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-prhv4_0d77122c-0812-4916-aea6-a2c325af973b/kube-rbac-proxy-self/0.log"
Jul 14 08:37:02.781191 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:02.781161    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6575f78bff-nwvp2_af542d5e-1557-491d-96de-f739dccf2a75/metrics-server/0.log"
Jul 14 08:37:02.809895 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:02.809851    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-8vmpb_8c0f0e87-b450-42b1-b391-c8a019454092/monitoring-plugin/0.log"
Jul 14 08:37:02.848114 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:02.848058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mgg9b_ac073049-a55c-4471-82b8-c6c689a15a5b/node-exporter/0.log"
Jul 14 08:37:02.873210 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:02.873178    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mgg9b_ac073049-a55c-4471-82b8-c6c689a15a5b/kube-rbac-proxy/0.log"
Jul 14 08:37:02.896725 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:02.896698    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mgg9b_ac073049-a55c-4471-82b8-c6c689a15a5b/init-textfile/0.log"
Jul 14 08:37:03.193501 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.193465    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01674c41-8880-4831-837e-3cdf59696a06/prometheus/0.log"
Jul 14 08:37:03.217683 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.217651    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01674c41-8880-4831-837e-3cdf59696a06/config-reloader/0.log"
Jul 14 08:37:03.243779 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.243746    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01674c41-8880-4831-837e-3cdf59696a06/thanos-sidecar/0.log"
Jul 14 08:37:03.273751 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.272870    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01674c41-8880-4831-837e-3cdf59696a06/kube-rbac-proxy-web/0.log"
Jul 14 08:37:03.299170 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.299134    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01674c41-8880-4831-837e-3cdf59696a06/kube-rbac-proxy/0.log"
Jul 14 08:37:03.326907 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.326816    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01674c41-8880-4831-837e-3cdf59696a06/kube-rbac-proxy-thanos/0.log"
Jul 14 08:37:03.351822 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.351792    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01674c41-8880-4831-837e-3cdf59696a06/init-config-reloader/0.log"
Jul 14 08:37:03.385019 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.384979    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-ch54t_b84d36e8-d929-4b91-8a5c-df927b58a15c/prometheus-operator/0.log"
Jul 14 08:37:03.404603 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:03.404538    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-ch54t_b84d36e8-d929-4b91-8a5c-df927b58a15c/kube-rbac-proxy/0.log"
Jul 14 08:37:05.285506 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.285210    2579 scope.go:117] "RemoveContainer" containerID="daa9b277f1fa10909ea9bbc7d9c8c1f3bb5a1a2639bfa786d9c2b4a35f4dddfa"
Jul 14 08:37:05.302360 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.302308    2579 scope.go:117] "RemoveContainer" containerID="ecabff27abb9a20efe517d12e436ec46b332f3a0739dd551ac2c04500ed15c23"
Jul 14 08:37:05.415023 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.414975    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"]
Jul 14 08:37:05.423704 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.423673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.428173 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.428140    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"]
Jul 14 08:37:05.549425 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.549329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-proc\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.549601 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.549489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8md4\" (UniqueName: \"kubernetes.io/projected/f6609cfc-bbed-4ef9-aada-9f67e0d23732-kube-api-access-k8md4\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.549601 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.549531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-podres\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.549601 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.549583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-lib-modules\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.549770 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.549613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-sys\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.650883 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.650841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-proc\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.651123 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.651000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8md4\" (UniqueName: \"kubernetes.io/projected/f6609cfc-bbed-4ef9-aada-9f67e0d23732-kube-api-access-k8md4\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.651123 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.651057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-podres\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.651256 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.651108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-lib-modules\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.651256 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.651156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-sys\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.651364 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.651290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-sys\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.651416 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.651373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-proc\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.651730 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.651700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-podres\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.651845 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.651749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6609cfc-bbed-4ef9-aada-9f67e0d23732-lib-modules\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.663880 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.663850    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8md4\" (UniqueName: \"kubernetes.io/projected/f6609cfc-bbed-4ef9-aada-9f67e0d23732-kube-api-access-k8md4\") pod \"perf-node-gather-daemonset-kbhnk\" (UID: \"f6609cfc-bbed-4ef9-aada-9f67e0d23732\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.743095 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.743051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:05.933974 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:05.933928    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"]
Jul 14 08:37:05.938701 ip-10-0-131-251 kubenswrapper[2579]: W0714 08:37:05.938672    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf6609cfc_bbed_4ef9_aada_9f67e0d23732.slice/crio-b0a8267ed8a6183b312a672ebb5ec0fe235664e6f6363e55bffa4e087c904a6d WatchSource:0}: Error finding container b0a8267ed8a6183b312a672ebb5ec0fe235664e6f6363e55bffa4e087c904a6d: Status 404 returned error can't find the container with id b0a8267ed8a6183b312a672ebb5ec0fe235664e6f6363e55bffa4e087c904a6d
Jul 14 08:37:06.298957 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:06.298919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk" event={"ID":"f6609cfc-bbed-4ef9-aada-9f67e0d23732","Type":"ContainerStarted","Data":"9277d137b4c226e7df0b4b835897d4aaec42449f85d7a44743e548029b98f0e5"}
Jul 14 08:37:06.299369 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:06.298974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk" event={"ID":"f6609cfc-bbed-4ef9-aada-9f67e0d23732","Type":"ContainerStarted","Data":"b0a8267ed8a6183b312a672ebb5ec0fe235664e6f6363e55bffa4e087c904a6d"}
Jul 14 08:37:06.299369 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:06.299056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:06.318787 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:06.317433    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk" podStartSLOduration=1.317406292 podStartE2EDuration="1.317406292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 08:37:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:37:06.314775754 +0000 UTC m=+2821.893782096" watchObservedRunningTime="2026-07-14 08:37:06.317406292 +0000 UTC m=+2821.896412642"
Jul 14 08:37:07.871614 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:07.871584    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4wjks_77515c6b-3d33-45f1-b182-b1f8e989171d/dns/0.log"
Jul 14 08:37:07.896276 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:07.896252    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4wjks_77515c6b-3d33-45f1-b182-b1f8e989171d/kube-rbac-proxy/0.log"
Jul 14 08:37:08.069951 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:08.069920    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lhd7p_4470a571-3e6e-4281-9e42-dbc7ed28ab42/dns-node-resolver/0.log"
Jul 14 08:37:08.635772 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:08.635737    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c9r5l_d1a6a9ee-55d0-49d1-9ba3-f29f1aa045bc/node-ca/0.log"
Jul 14 08:37:09.873461 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:09.873433    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b677bd8c7-dxpbt_fbfdcab9-16fe-47c0-a4e8-507d52db0f08/kube-auth-proxy/0.log"
Jul 14 08:37:10.787368 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:10.787334    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4lcn5_d55506b5-72dd-4f10-95bc-2abba901d2fa/serve-healthcheck-canary/0.log"
Jul 14 08:37:11.432972 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:11.432935    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xc8pq_68265154-53df-4b2e-94da-11819b064085/kube-rbac-proxy/0.log"
Jul 14 08:37:11.456610 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:11.456581    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xc8pq_68265154-53df-4b2e-94da-11819b064085/exporter/0.log"
Jul 14 08:37:11.480667 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:11.480639    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xc8pq_68265154-53df-4b2e-94da-11819b064085/extractor/0.log"
Jul 14 08:37:12.318178 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:12.318150    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-kbhnk"
Jul 14 08:37:13.744890 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:13.744852    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bnghd_0869c527-08bb-47f0-8364-68fe17acf08b/manager/0.log"
Jul 14 08:37:14.289875 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:14.289815    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-r66q8_3dfd42c7-5169-4300-afb4-0855b1cb78ed/manager/0.log"
Jul 14 08:37:14.311513 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:14.311488    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-r66q8_3dfd42c7-5169-4300-afb4-0855b1cb78ed/copy-manifests/0.log"
Jul 14 08:37:15.835955 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:15.835930    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67649569dd-9sfrs_99adf0a4-900f-483d-b9cf-1640e3495b2a/manager/0.log"
Jul 14 08:37:15.928085 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:15.927986    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zkjwd_a1d936aa-2983-4ebd-9c90-4862ecd909e4/openshift-lws-operator/0.log"
Jul 14 08:37:15.972175 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:15.972139    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b677bd8c7-dxpbt_fbfdcab9-16fe-47c0-a4e8-507d52db0f08/kube-auth-proxy/0.log"
Jul 14 08:37:17.618785 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:17.618749    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b677bd8c7-dxpbt_fbfdcab9-16fe-47c0-a4e8-507d52db0f08/kube-auth-proxy/0.log"
Jul 14 08:37:22.852436 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:22.852360    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdq6p_6319dcc6-4314-441a-a84b-bfcb62468c2b/kube-multus-additional-cni-plugins/0.log"
Jul 14 08:37:22.883980 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:22.883950    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdq6p_6319dcc6-4314-441a-a84b-bfcb62468c2b/egress-router-binary-copy/0.log"
Jul 14 08:37:22.910314 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:22.910286    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdq6p_6319dcc6-4314-441a-a84b-bfcb62468c2b/cni-plugins/0.log"
Jul 14 08:37:22.937801 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:22.937768    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdq6p_6319dcc6-4314-441a-a84b-bfcb62468c2b/bond-cni-plugin/0.log"
Jul 14 08:37:22.965388 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:22.965362    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdq6p_6319dcc6-4314-441a-a84b-bfcb62468c2b/routeoverride-cni/0.log"
Jul 14 08:37:22.991793 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:22.991764    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdq6p_6319dcc6-4314-441a-a84b-bfcb62468c2b/whereabouts-cni-bincopy/0.log"
Jul 14 08:37:23.017430 ip-10-0-131-251 kubenswrapper[2579]: I0714 08:37:23.017399    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jdq6p_6319dcc6-4314-441a-a84b-bfcb62468c2b/whereabouts-cni/0.log"