Jul 07 18:50:02.656891 ip-10-0-142-228 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.055798    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061166    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061180    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061183    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061186    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061191    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061195    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061198    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:03.089582 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061202    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061205    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061210    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061216    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061238    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061241    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061244    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061246    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061251    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061254    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061256    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061261    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061263    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061267    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061269    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061274    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061277    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061279    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061282    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:03.091022 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061287    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061289    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061292    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061298    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061301    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061304    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061309    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061312    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061315    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061319    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061322    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061325    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061328    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061332    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061335    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061337    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061340    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061344    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061347    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:03.092114 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061349    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061354    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061357    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061359    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061362    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061366    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061368    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061371    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061373    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061376    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061379    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061389    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061393    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061396    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061401    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061403    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061406    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061410    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061413    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061415    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:03.093015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061418    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061422    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061426    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061429    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061431    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061436    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061439    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061441    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061446    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061448    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061451    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061454    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061458    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061461    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061463    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061466    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061470    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061473    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061475    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061478    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:03.094129 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061482    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061485    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061488    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061492    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061495    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061497    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061500    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061504    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061507    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061509    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061511    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061517    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061521    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.061524    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062245    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062252    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062255    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062258    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062262    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:03.095012 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062267    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062269    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062272    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062275    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062278    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062280    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062284    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062287    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062289    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062292    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062295    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062297    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062300    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062302    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062305    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062308    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062311    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062314    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062317    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062319    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:03.096343 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062322    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062324    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062327    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062330    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062332    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062335    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062337    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062340    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062343    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062345    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062347    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062350    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062353    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062357    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062360    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062363    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062366    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062370    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062372    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:03.097224 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062375    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062378    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062380    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062383    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062385    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062388    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062390    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062393    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062396    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062400    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062403    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062406    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062408    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062411    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062413    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062416    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062418    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062421    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062424    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062426    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:03.099183 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062429    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062431    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062434    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062436    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062439    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062442    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062446    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062453    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062456    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062459    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062461    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062464    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062467    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062470    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062473    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062476    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062479    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062481    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062484    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062487    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:03.100041 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062489    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062492    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062494    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062497    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062499    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062502    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062505    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062507    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062510    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062513    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062515    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062518    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062520    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062523    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062526    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062906    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062911    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062914    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062917    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062921    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:03.101365 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062924    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062926    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062929    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062931    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062934    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062937    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062939    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062942    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062944    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062947    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062950    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062952    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062954    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062957    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062960    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062962    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062965    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062968    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062971    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062973    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:03.102239 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062976    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062978    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062981    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062983    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062986    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062988    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062991    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062994    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062996    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.062999    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063002    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063008    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063012    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063014    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063017    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063019    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063023    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063027    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063030    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063033    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:03.103110 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063036    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063038    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063042    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063045    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063047    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063051    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063059    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063062    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063064    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063067    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063069    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063072    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063074    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063077    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063079    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063082    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063084    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063087    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063089    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:03.103976 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063092    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063094    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063097    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063101    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063106    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063109    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063113    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063116    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063118    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063121    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063123    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063126    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063128    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063131    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063133    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063136    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063139    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063141    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063144    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:03.106122 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063147    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063150    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063152    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063155    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063157    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063160    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063162    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063165    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063167    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063170    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063172    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063175    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063178    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063180    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063183    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063185    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063257    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063265    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063271    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063276    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 18:50:03.107193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063280    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063284    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063288    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063292    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063295    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063298    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063301    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063305    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063308    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063311    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063313    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063316    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063321    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063324    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063329    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063332    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063335    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063339    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063342    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063346    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063349    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063352    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063355    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063358    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 18:50:03.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063361    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063365    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063368    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063370    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063375    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063380    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063383    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063386    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063389    2577 flags.go:64] FLAG: --enable-server="true"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063392    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063396    2577 flags.go:64] FLAG: --event-burst="100"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063414    2577 flags.go:64] FLAG: --event-qps="50"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063418    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063421    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063424    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063428    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063430    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063433    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063436    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063439    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063443    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063446    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063449    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063452    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063455    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 18:50:03.109598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063458    2577 flags.go:64] FLAG: --feature-gates=""
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063462    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063465    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063468    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063471    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063474    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063477    2577 flags.go:64] FLAG: --help="false"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063480    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-142-228.ec2.internal"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063483    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063485    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063488    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063491    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063496    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063499    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063502    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063505    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063508    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063511    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063515    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063518    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063521    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063524    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063527    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063530    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 18:50:03.118488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063533    2577 flags.go:64] FLAG: --lock-file=""
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063535    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063538    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063542    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063547    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063550    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063553    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063556    2577 flags.go:64] FLAG: --logging-format="text"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063558    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063562    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063564    2577 flags.go:64] FLAG: --manifest-url=""
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063567    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063572    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063575    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063579    2577 flags.go:64] FLAG: --max-pods="110"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063582    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063598    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063601    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063604    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063607    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063611    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063614    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063621    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063623    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063626    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 18:50:03.119575 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063629    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063634    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063639    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063642    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063645    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063648    2577 flags.go:64] FLAG: --port="10250"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063651    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063654    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09aa4a552644f8e22"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063657    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063660    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063664    2577 flags.go:64] FLAG: --register-node="true"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063667    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063671    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063674    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063677    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063680    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063683    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063686    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063689    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063692    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063695    2577 flags.go:64] FLAG: --runonce="false"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063697    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063701    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063703    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063706    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 18:50:03.121521 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063709    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063712    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063715    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063720    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063723    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063726    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063729    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063732    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063735    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063739    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063742    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063747    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063750    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063752    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063757    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063760    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063762    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063766    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063769    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063772    2577 flags.go:64] FLAG: --v="2"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063776    2577 flags.go:64] FLAG: --version="false"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063780    2577 flags.go:64] FLAG: --vmodule=""
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063786    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.063789    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063903    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:03.122609 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063907    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063911    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063913    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063916    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063918    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063921    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063924    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063926    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063929    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063932    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063936    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063939    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063941    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063944    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063947    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063949    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063953    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063963    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063966    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063969    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:03.124509 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063971    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063974    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063977    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063979    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063984    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063988    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063992    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063994    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.063997    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064000    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064003    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064005    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064008    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064010    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064013    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064015    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064018    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064020    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064023    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:03.191198 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064025    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064028    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064031    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064035    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064037    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064040    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064042    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064045    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064047    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064050    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064053    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064061    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064064    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064066    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064069    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064071    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064074    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064078    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064081    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064083    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:03.193017 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064086    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064088    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064091    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064093    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064096    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064098    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064101    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064104    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064106    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064109    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064111    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064114    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064116    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064119    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064121    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064125    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064127    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064130    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064133    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:03.193906 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064135    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064138    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064140    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064142    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064145    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064154    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064158    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064161    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064163    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064166    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064170    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064172    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064175    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064177    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064180    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064184    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064187    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064190    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:03.196336 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064193    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.064196    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.064844    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.075618    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.075635    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.075654    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.075660    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075726    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075732    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075735    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075738    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075741    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075744    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075746    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075749    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:03.197202 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075753    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075755    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075759    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075762    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075765    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075768    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075771    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075774    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075781    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075784    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075786    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075789    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075792    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075794    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075797    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075800    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075802    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075805    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075809    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:03.199154 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075812    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075815    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075818    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075820    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075823    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075826    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075828    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075831    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075833    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075836    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075839    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075841    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075844    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075846    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075849    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075858    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075863    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075866    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075874    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075877    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:03.200019 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075880    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075882    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075885    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075887    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075890    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075892    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075895    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075897    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075900    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075903    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075911    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075913    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075916    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075919    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075921    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075924    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075926    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075929    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075931    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075934    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:03.203056 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075936    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075939    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075941    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075944    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075946    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075949    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075951    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075955    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075959    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075963    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075966    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075976    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075979    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075982    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075985    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075988    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075990    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075993    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075996    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.075998    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:03.203919 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076001    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076003    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076006    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076008    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076011    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076013    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076016    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076018    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076021    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076025    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076028    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076030    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.076035    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076188    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:03.206923 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076193    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076196    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076199    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076201    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076204    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076208    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076211    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076216    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076219    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076222    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076230    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076234    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076236    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076239    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076242    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076244    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076247    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076251    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076254    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:03.207572 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076257    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076260    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076263    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076266    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076269    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076271    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076273    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076276    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076278    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076281    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076283    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076285    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076288    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076291    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076293    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076296    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076298    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076301    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076304    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076307    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:03.210175 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076311    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076314    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076316    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076319    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076327    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076329    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076332    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076334    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076337    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076340    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076342    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076344    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076347    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076350    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076352    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076355    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076357    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076360    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076362    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:03.211061 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076365    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076367    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076370    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076372    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076375    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076377    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076381    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076384    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076387    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076390    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076393    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076396    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076398    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076402    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076405    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076408    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076410    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076412    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076420    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:03.213015 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076423    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076426    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076428    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076431    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076433    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076436    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076439    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076441    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076443    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076446    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076449    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076451    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076454    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076456    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076459    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076461    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076464    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076466    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076468    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076471    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:03.213903 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:03.076473    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.076478    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.076620    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.078652    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.080026    2577 server.go:1019] "Starting client certificate rotation"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.080137    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.080179    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.082637    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.135932    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.156713    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.158846    2577 log.go:25] "Validated CRI v1 image API"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.159675    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 18:50:03.216916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.172956    2577 fs.go:135] Filesystem UUIDs: map[62f55eb6-ff8a-4a6c-be0e-742ece8b57e7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8b45f026-d973-468e-88db-8205597db31a:/dev/nvme0n1p4]
Jul 07 18:50:03.217566 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.172975    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 18:50:03.219918 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.178220    2577 manager.go:216] Machine: {Timestamp:2026-07-07 18:50:03.176924702 +0000 UTC m=+0.402857425 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105290 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a75fbac7c14b1cc6663169f20649a SystemUUID:ec2a75fb-ac7c-14b1-cc66-63169f20649a BootID:1bfbb67f-a42c-4839-9417-c5c17f3f6d40 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:b1:15:10:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:b1:15:10:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:33:e2:fc:5b:5c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 18:50:03.219918 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.178320    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 18:50:03.219918 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.178400    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 18:50:03.219918 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.181195    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 18:50:03.219918 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.181268    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 18:50:03.219918 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.182619    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 18:50:03.219918 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.182632    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 18:50:03.219918 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.182642    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.183105    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.184694    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.187556    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.187703    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.187735    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.187753    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.187772    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.187785    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.187796    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.188230    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:50:03.220559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.188249    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.234836    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.234936    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.236818    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.236846    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.237330    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ltvms"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.237351    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ltvms"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238240    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238254    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238260    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238266    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238275    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238281    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238290    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238296    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238302    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238308    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238316    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.238321    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.239035    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.239042    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.242411    2577 server.go:1268] "Started kubelet"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.242741    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.243117    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.243163    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.262572    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:03.264401    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.264659    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.266504    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.268479    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.269565    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.269578    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:03.269697    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270478    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270489    2577 factory.go:55] Registering systemd factory
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270495    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270690    2577 factory.go:153] Registering CRI-O factory
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270705    2577 factory.go:223] Registration of the crio container factory successfully
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270736    2577 factory.go:103] Registering Raw factory
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270748    2577 manager.go:1196] Started watching for new ooms in manager
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270921    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270923    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 18:50:03.291926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.270950    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 18:50:03.243330 ip-10-0-142-228 systemd[1]: Started Kubernetes Kubelet.
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.271071    2577 manager.go:349] Starting recovery of all containers
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.271091    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.271105    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.272148    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.273311    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-228.ec2.internal" not found
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:03.274928    2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-228.ec2.internal\" not found" node="ip-10-0-142-228.ec2.internal"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.281652    2577 manager.go:354] Recovery completed
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.287306    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.288935    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.288961    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.288971    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.289462    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.289473    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.289483    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.289496    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.290156    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.290181    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.290194    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.290824    2577 policy_none.go:49] "None policy: Start"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.290845    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.290855    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.291209    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-228.ec2.internal" not found
Jul 07 18:50:03.294607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.291942    2577 policy_none.go:47] "Start"
Jul 07 18:50:03.387849 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:03.366374    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-228.ec2.internal" not found
Jul 07 18:50:03.387849 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:03.370598    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-228.ec2.internal\" not found"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.858979    2577 manager.go:337] "Starting Device Plugin manager"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:04.859158    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.859172    2577 server.go:87] "Starting device plugin registration server"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.859405    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.859436    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.859598    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.859672    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.859680    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:04.860069    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 18:50:04.940721 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:04.860116    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-228.ec2.internal\" not found"
Jul 07 18:50:04.960064 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.960049    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:04.961858 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.961841    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:04.961931 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.961873    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:04.961931 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.961886    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:04.961931 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.961908    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-228.ec2.internal"
Jul 07 18:50:04.972472 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.972457    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-228.ec2.internal"
Jul 07 18:50:04.972536 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:04.972478    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-228.ec2.internal\": node \"ip-10-0-142-228.ec2.internal\" not found"
Jul 07 18:50:04.997175 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.997143    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 18:50:04.998266 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.998254    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 18:50:04.998315 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.998299    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 18:50:04.998348 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:04.998318    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 18:50:04.998379 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:04.998347    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 18:50:05.000825 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.000810    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:05.099205 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.099180    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal"]
Jul 07 18:50:05.100977 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.100963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.102118 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.102099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.132548 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.132524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1031a34e2c9fcb7ef3b4306f0e919116-config\") pod \"kube-apiserver-proxy-ip-10-0-142-228.ec2.internal\" (UID: \"1031a34e2c9fcb7ef3b4306f0e919116\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.132640 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.132553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/abaeec0cb4dabc388094eb80c5e741b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"abaeec0cb4dabc388094eb80c5e741b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.132640 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.132572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abaeec0cb4dabc388094eb80c5e741b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"abaeec0cb4dabc388094eb80c5e741b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.134960 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.134948    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.139154 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.139140    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.149273 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.149256    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:50:05.152044 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.152015    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:50:05.232913 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.232857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/abaeec0cb4dabc388094eb80c5e741b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"abaeec0cb4dabc388094eb80c5e741b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.232913 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.232880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abaeec0cb4dabc388094eb80c5e741b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"abaeec0cb4dabc388094eb80c5e741b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.232913 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.232898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1031a34e2c9fcb7ef3b4306f0e919116-config\") pod \"kube-apiserver-proxy-ip-10-0-142-228.ec2.internal\" (UID: \"1031a34e2c9fcb7ef3b4306f0e919116\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.233069 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.232935    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1031a34e2c9fcb7ef3b4306f0e919116-config\") pod \"kube-apiserver-proxy-ip-10-0-142-228.ec2.internal\" (UID: \"1031a34e2c9fcb7ef3b4306f0e919116\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.233069 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.232963    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/abaeec0cb4dabc388094eb80c5e741b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"abaeec0cb4dabc388094eb80c5e741b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.233069 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.232969    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abaeec0cb4dabc388094eb80c5e741b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal\" (UID: \"abaeec0cb4dabc388094eb80c5e741b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.452268 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.452241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.456362 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.456008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal"
Jul 07 18:50:05.539270 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.539206    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 18:50:05.539381 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.539320    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:50:05.539381 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.539349    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:50:05.539508 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.539383    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:50:05.648255 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.648224    2577 apiserver.go:52] "Watching apiserver"
Jul 07 18:50:05.665595 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.665574    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 18:50:05.665935 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.665916    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-crb9r","openshift-ovn-kubernetes/ovnkube-node-k6qpg","kube-system/global-pull-secret-syncer-hrwfd","kube-system/konnectivity-agent-6zd52","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz","openshift-cluster-node-tuning-operator/tuned-k86x9","openshift-dns/node-resolver-8w5xp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal","openshift-multus/multus-4jx7p","openshift-multus/network-metrics-daemon-ftpks","kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal","openshift-image-registry/node-ca-qj68x","openshift-multus/multus-additional-cni-plugins-4ngsq","openshift-network-diagnostics/network-check-target-59xj2"]
Jul 07 18:50:05.667356 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.667336    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.668799 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.668777    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.670147 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.670133    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.671649 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.671634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:05.672530 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.672510    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 18:50:05.672756 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.672739    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 18:50:05.672829 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.672758    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p7l6n\""
Jul 07 18:50:05.673246 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.673130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.673246 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.673232    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:05.673397 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.673318    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 18:50:05.675279 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.675052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.675945 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.675916    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 18:50:05.675945 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.675933    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 18:50:05.676097 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.676017    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 18:50:05.676097 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.675931    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 18:50:05.676097 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.676040    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 18:50:05.676097 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.676084    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sprrl\""
Jul 07 18:50:05.676288 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.676188    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 18:50:05.676288 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.676228    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 18:50:05.676358 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.676305    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xvwfr\""
Jul 07 18:50:05.676491 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.676478    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 18:50:05.676857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.676845    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.678049 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.678036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.679302 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.679288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:05.679374 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.679335    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:05.680478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.680465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.681392 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.681376    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 18:50:05.681531 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.681514    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 18:50:05.681600 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.681570    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-24t8q\""
Jul 07 18:50:05.681600 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.681587    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 18:50:05.681600 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.681591    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:50:05.681745 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.681644    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s6rdr\""
Jul 07 18:50:05.681893 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.681878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.683142 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.683127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:05.683187 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.683174    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:05.685125 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685111    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:50:05.685223 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685209    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 18:50:05.685273 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685209    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 18:50:05.685331 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685302    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 18:50:05.685380 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685341    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 18:50:05.685380 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685353    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 18:50:05.685503 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685387    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fdngd\""
Jul 07 18:50:05.685503 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685402    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lcbr5\""
Jul 07 18:50:05.685503 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685444    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 18:50:05.685503 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.685489    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 18:50:05.688869 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.688840    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 18:50:05.688999 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.688979    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 18:50:05.689100 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.689030    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 18:50:05.689100 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.689057    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 18:50:05.689201 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.689146    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d86d4\""
Jul 07 18:50:05.689375 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.689362    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vdkg8\""
Jul 07 18:50:05.701884 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.701849    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:45:04 +0000 UTC" deadline="2028-02-26 09:15:24.045280688 +0000 UTC"
Jul 07 18:50:05.701884 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.701882    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14366h25m18.34340062s"
Jul 07 18:50:05.730456 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.730444    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 18:50:05.732053 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.732041    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 18:50:05.735677 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735662    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-cnibin\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.735730 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-os-release\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.735730 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-var-lib-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.735793 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.735793 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.735793 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovnkube-config\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.735793 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lszqt\" (UniqueName: \"kubernetes.io/projected/5551bdd5-abf7-4125-a584-84e6cf547394-kube-api-access-lszqt\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.735904 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.735904 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.735904 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-kubelet-config\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.735904 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f522df3-b6d9-4e6f-a838-c17958c067c4-tmp\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.735904 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2pmw\" (UniqueName: \"kubernetes.io/projected/7230ed43-8af3-4249-8e93-7045e0921ce2-kube-api-access-t2pmw\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:05.736048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-system-cni-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-os-release\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-hostroot\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbaf2cd6-c6bb-46bf-9540-c056445ce658-tmp-dir\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.736048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.735985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-tuned\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/461b6e43-3eb4-437e-99a6-9675ea6c3e16-serviceca\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.736048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-cni-netd\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-modprobe-d\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-cni-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-run-netns\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-systemd\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-log-socket\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bbaf2cd6-c6bb-46bf-9540-c056445ce658-hosts-file\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5551bdd5-abf7-4125-a584-84e6cf547394-iptables-alerter-script\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-registration-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-device-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-cni-bin\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovn-node-metrics-cert\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-systemd\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-kubelet\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/140597b9-f015-41b7-863d-e780e413f042-multus-daemon-config\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-cnibin\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-node-log\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736365    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-ovn\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-sys-fs\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-system-cni-dir\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736476    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-kubernetes\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysctl-d\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-socket-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.736629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-k8s-cni-cncf-io\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-etc-kubernetes\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-systemd-units\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5551bdd5-abf7-4125-a584-84e6cf547394-host-slash\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/461b6e43-3eb4-437e-99a6-9675ea6c3e16-host\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovnkube-script-lib\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgsqh\" (UniqueName: \"kubernetes.io/projected/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-kube-api-access-vgsqh\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736661    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysctl-conf\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-lib-modules\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-var-lib-kubelet\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-multus-certs\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysconfig\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xm2\" (UniqueName: \"kubernetes.io/projected/bab075a0-179b-4731-b520-a770bd0d876c-kube-api-access-s5xm2\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.736972 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9cw\" (UniqueName: \"kubernetes.io/projected/140597b9-f015-41b7-863d-e780e413f042-kube-api-access-6l9cw\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-slash\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-run\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a38c374-ad30-41f0-a749-58add7354c77-agent-certs\") pod \"konnectivity-agent-6zd52\" (UID: \"5a38c374-ad30-41f0-a749-58add7354c77\") " pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a38c374-ad30-41f0-a749-58add7354c77-konnectivity-ca\") pod \"konnectivity-agent-6zd52\" (UID: \"5a38c374-ad30-41f0-a749-58add7354c77\") " pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-socket-dir-parent\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-conf-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-host\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr5g7\" (UniqueName: \"kubernetes.io/projected/0f522df3-b6d9-4e6f-a838-c17958c067c4-kube-api-access-zr5g7\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/140597b9-f015-41b7-863d-e780e413f042-cni-binary-copy\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.736981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-netns\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8ck2\" (UniqueName: \"kubernetes.io/projected/461b6e43-3eb4-437e-99a6-9675ea6c3e16-kube-api-access-b8ck2\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl62k\" (UniqueName: \"kubernetes.io/projected/35a09e90-3ebf-4269-a4c9-46151364434c-kube-api-access-dl62k\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.737350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-kubelet\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtsm6\" (UniqueName: \"kubernetes.io/projected/bbaf2cd6-c6bb-46bf-9540-c056445ce658-kube-api-access-gtsm6\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-dbus\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-sys\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-cni-bin\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-cni-multus\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-etc-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-env-overrides\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.737736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.737192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-etc-selinux\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.746071 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.746055    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:50:05.775098 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.775080    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5nfh"
Jul 07 18:50:05.785069 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.785055    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5nfh"
Jul 07 18:50:05.837848 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:05.837848 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-sys-fs\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-system-cni-dir\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-kubernetes\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysctl-d\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-socket-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-k8s-cni-cncf-io\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-etc-kubernetes\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837956    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-sys-fs\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.837989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.837961    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-system-cni-dir\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.838036    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838079    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-kubernetes\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838079    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysctl-d\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838091    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-k8s-cni-cncf-io\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.838116    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs podName:7230ed43-8af3-4249-8e93-7045e0921ce2 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:06.338092882 +0000 UTC m=+2.104200246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs") pod "network-metrics-daemon-ftpks" (UID: "7230ed43-8af3-4249-8e93-7045e0921ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-systemd-units\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5551bdd5-abf7-4125-a584-84e6cf547394-host-slash\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838183    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-etc-kubernetes\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838195    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-socket-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838231    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-systemd-units\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838271    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5551bdd5-abf7-4125-a584-84e6cf547394-host-slash\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838304    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.838402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/461b6e43-3eb4-437e-99a6-9675ea6c3e16-host\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838330    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/461b6e43-3eb4-437e-99a6-9675ea6c3e16-host\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovnkube-script-lib\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgsqh\" (UniqueName: \"kubernetes.io/projected/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-kube-api-access-vgsqh\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysctl-conf\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-lib-modules\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-var-lib-kubelet\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-multus-certs\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838471    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-var-lib-kubelet\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysconfig\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xm2\" (UniqueName: \"kubernetes.io/projected/bab075a0-179b-4731-b520-a770bd0d876c-kube-api-access-s5xm2\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838520    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-lib-modules\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838525    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-multus-certs\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9cw\" (UniqueName: \"kubernetes.io/projected/140597b9-f015-41b7-863d-e780e413f042-kube-api-access-6l9cw\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838546    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysctl-conf\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839080 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-slash\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838612    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-sysconfig\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838632    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-slash\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-run\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a38c374-ad30-41f0-a749-58add7354c77-agent-certs\") pod \"konnectivity-agent-6zd52\" (UID: \"5a38c374-ad30-41f0-a749-58add7354c77\") " pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838742    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a38c374-ad30-41f0-a749-58add7354c77-konnectivity-ca\") pod \"konnectivity-agent-6zd52\" (UID: \"5a38c374-ad30-41f0-a749-58add7354c77\") " pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-socket-dir-parent\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.838844    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838869    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-run\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-conf-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.838898    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret podName:5d65a8f1-ab8f-46d0-a54b-aebd01376b95 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:06.338882347 +0000 UTC m=+2.104989703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret") pod "global-pull-secret-syncer-hrwfd" (UID: "5d65a8f1-ab8f-46d0-a54b-aebd01376b95") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838923    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-conf-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.839771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-host\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838941    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-socket-dir-parent\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5g7\" (UniqueName: \"kubernetes.io/projected/0f522df3-b6d9-4e6f-a838-c17958c067c4-kube-api-access-zr5g7\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/140597b9-f015-41b7-863d-e780e413f042-cni-binary-copy\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.838986    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovnkube-script-lib\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-netns\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839013    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-host\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8ck2\" (UniqueName: \"kubernetes.io/projected/461b6e43-3eb4-437e-99a6-9675ea6c3e16-kube-api-access-b8ck2\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl62k\" (UniqueName: \"kubernetes.io/projected/35a09e90-3ebf-4269-a4c9-46151364434c-kube-api-access-dl62k\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839066    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-kubelet\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtsm6\" (UniqueName: \"kubernetes.io/projected/bbaf2cd6-c6bb-46bf-9540-c056445ce658-kube-api-access-gtsm6\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-dbus\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-sys\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-cni-bin\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.840326 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-cni-multus\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839268    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-kubelet\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839302    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-etc-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-env-overrides\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-etc-selinux\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-cnibin\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839377    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-sys\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839378    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-etc-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-os-release\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839439    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-cni-multus\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-var-lib-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839479    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-var-lib-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839528    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-dbus\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovnkube-config\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839552    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-openvswitch\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszqt\" (UniqueName: \"kubernetes.io/projected/5551bdd5-abf7-4125-a584-84e6cf547394-kube-api-access-lszqt\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839571    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-os-release\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839576    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/140597b9-f015-41b7-863d-e780e413f042-cni-binary-copy\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839325    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-cni-bin\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839678    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-etc-selinux\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839530    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-cnibin\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839769    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a38c374-ad30-41f0-a749-58add7354c77-konnectivity-ca\") pod \"konnectivity-agent-6zd52\" (UID: \"5a38c374-ad30-41f0-a749-58add7354c77\") " pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839769    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839078    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-run-netns\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.841648 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-kubelet-config\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839906    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839913    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-env-overrides\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f522df3-b6d9-4e6f-a838-c17958c067c4-tmp\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839975    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-kubelet-config\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.839989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2pmw\" (UniqueName: \"kubernetes.io/projected/7230ed43-8af3-4249-8e93-7045e0921ce2-kube-api-access-t2pmw\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-system-cni-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-os-release\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840094    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovnkube-config\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840184    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-hostroot\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbaf2cd6-c6bb-46bf-9540-c056445ce658-tmp-dir\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840239    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-hostroot\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840247    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-os-release\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.842028 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-tuned\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/461b6e43-3eb4-437e-99a6-9675ea6c3e16-serviceca\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840284    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-system-cni-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-cni-netd\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-modprobe-d\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840441    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-cni-netd\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840503    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-modprobe-d\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-cni-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-run-netns\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840578    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-multus-cni-dir\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-systemd\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840594    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbaf2cd6-c6bb-46bf-9540-c056445ce658-tmp-dir\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-log-socket\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840657    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-run-netns\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bbaf2cd6-c6bb-46bf-9540-c056445ce658-hosts-file\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.842478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840694    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/461b6e43-3eb4-437e-99a6-9675ea6c3e16-serviceca\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840701    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-log-socket\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840702    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bbaf2cd6-c6bb-46bf-9540-c056445ce658-hosts-file\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5551bdd5-abf7-4125-a584-84e6cf547394-iptables-alerter-script\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840739    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-systemd\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-registration-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-device-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840825    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-cni-bin\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840858    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-device-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovn-node-metrics-cert\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840907    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-host-cni-bin\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-systemd\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.843167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-kubelet\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/140597b9-f015-41b7-863d-e780e413f042-multus-daemon-config\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.840997    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-systemd\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-cnibin\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841031    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140597b9-f015-41b7-863d-e780e413f042-host-var-lib-kubelet\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-node-log\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-ovn\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841222    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-run-ovn\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841296    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bab075a0-179b-4731-b520-a770bd0d876c-cnibin\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841345    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5551bdd5-abf7-4125-a584-84e6cf547394-iptables-alerter-script\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841432    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35a09e90-3ebf-4269-a4c9-46151364434c-registration-dir\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841484    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-node-log\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841535    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/140597b9-f015-41b7-863d-e780e413f042-multus-daemon-config\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.841854    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bab075a0-179b-4731-b520-a770bd0d876c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.843868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.842724    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f522df3-b6d9-4e6f-a838-c17958c067c4-etc-tuned\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.844607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.842791    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f522df3-b6d9-4e6f-a838-c17958c067c4-tmp\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:05.844607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.843004    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-ovn-node-metrics-cert\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.844607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.843012    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a38c374-ad30-41f0-a749-58add7354c77-agent-certs\") pod \"konnectivity-agent-6zd52\" (UID: \"5a38c374-ad30-41f0-a749-58add7354c77\") " pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:05.851865 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.851848    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:05.851935 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.851871    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:05.851935 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.851884    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rxjm2 for pod openshift-network-diagnostics/network-check-target-59xj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:05.852036 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:05.851940    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2 podName:fabc8876-768c-4139-86a3-eaef84dba62c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:06.351924404 +0000 UTC m=+2.118031766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rxjm2" (UniqueName: "kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2") pod "network-check-target-59xj2" (UID: "fabc8876-768c-4139-86a3-eaef84dba62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:05.854520 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.854496    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8ck2\" (UniqueName: \"kubernetes.io/projected/461b6e43-3eb4-437e-99a6-9675ea6c3e16-kube-api-access-b8ck2\") pod \"node-ca-qj68x\" (UID: \"461b6e43-3eb4-437e-99a6-9675ea6c3e16\") " pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:05.854656 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.854635    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lszqt\" (UniqueName: \"kubernetes.io/projected/5551bdd5-abf7-4125-a584-84e6cf547394-kube-api-access-lszqt\") pod \"iptables-alerter-crb9r\" (UID: \"5551bdd5-abf7-4125-a584-84e6cf547394\") " pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:05.854748 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.854635    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xm2\" (UniqueName: \"kubernetes.io/projected/bab075a0-179b-4731-b520-a770bd0d876c-kube-api-access-s5xm2\") pod \"multus-additional-cni-plugins-4ngsq\" (UID: \"bab075a0-179b-4731-b520-a770bd0d876c\") " pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:05.854748 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.854711    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl62k\" (UniqueName: \"kubernetes.io/projected/35a09e90-3ebf-4269-a4c9-46151364434c-kube-api-access-dl62k\") pod \"aws-ebs-csi-driver-node-758mz\" (UID: \"35a09e90-3ebf-4269-a4c9-46151364434c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:05.854841 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.854752    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9cw\" (UniqueName: \"kubernetes.io/projected/140597b9-f015-41b7-863d-e780e413f042-kube-api-access-6l9cw\") pod \"multus-4jx7p\" (UID: \"140597b9-f015-41b7-863d-e780e413f042\") " pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:05.854940 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.854924    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtsm6\" (UniqueName: \"kubernetes.io/projected/bbaf2cd6-c6bb-46bf-9540-c056445ce658-kube-api-access-gtsm6\") pod \"node-resolver-8w5xp\" (UID: \"bbaf2cd6-c6bb-46bf-9540-c056445ce658\") " pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:05.855379 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.855355    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2pmw\" (UniqueName: \"kubernetes.io/projected/7230ed43-8af3-4249-8e93-7045e0921ce2-kube-api-access-t2pmw\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:05.856744 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.856722    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgsqh\" (UniqueName: \"kubernetes.io/projected/eeda4633-f0ab-4f08-8926-47a5bf7a7c1d-kube-api-access-vgsqh\") pod \"ovnkube-node-k6qpg\" (UID: \"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:05.856999 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:05.856980    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5g7\" (UniqueName: \"kubernetes.io/projected/0f522df3-b6d9-4e6f-a838-c17958c067c4-kube-api-access-zr5g7\") pod \"tuned-k86x9\" (UID: \"0f522df3-b6d9-4e6f-a838-c17958c067c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:06.005387 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.005359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz"
Jul 07 18:50:06.021252 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.021228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:06.045059 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.044998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8w5xp"
Jul 07 18:50:06.054378 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.054347    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabaeec0cb4dabc388094eb80c5e741b9.slice/crio-50ef4408d80d742741f4d882f57a83cf79bf0ddaa4d0ce8e6b877c7e72b2277e WatchSource:0}: Error finding container 50ef4408d80d742741f4d882f57a83cf79bf0ddaa4d0ce8e6b877c7e72b2277e: Status 404 returned error can't find the container with id 50ef4408d80d742741f4d882f57a83cf79bf0ddaa4d0ce8e6b877c7e72b2277e
Jul 07 18:50:06.054566 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.054550    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1031a34e2c9fcb7ef3b4306f0e919116.slice/crio-1ce735c0d432838e930c15988f01b947cba12b64b7461557d2b9fe31651499c0 WatchSource:0}: Error finding container 1ce735c0d432838e930c15988f01b947cba12b64b7461557d2b9fe31651499c0: Status 404 returned error can't find the container with id 1ce735c0d432838e930c15988f01b947cba12b64b7461557d2b9fe31651499c0
Jul 07 18:50:06.055575 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.055555    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbaf2cd6_c6bb_46bf_9540_c056445ce658.slice/crio-44f57df95c4475ef0f6b58c02a3b3b8520a5602dd8d7a9559672b7b96d81a462 WatchSource:0}: Error finding container 44f57df95c4475ef0f6b58c02a3b3b8520a5602dd8d7a9559672b7b96d81a462: Status 404 returned error can't find the container with id 44f57df95c4475ef0f6b58c02a3b3b8520a5602dd8d7a9559672b7b96d81a462
Jul 07 18:50:06.057923 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.057900    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:06.059238 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.059224    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:50:06.064305 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.064286    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k86x9"
Jul 07 18:50:06.068034 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.068006    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a38c374_ad30_41f0_a749_58add7354c77.slice/crio-e7f5aa058b0a126a91887657046276688a05ad84e0f2359f25011034098fb0ba WatchSource:0}: Error finding container e7f5aa058b0a126a91887657046276688a05ad84e0f2359f25011034098fb0ba: Status 404 returned error can't find the container with id e7f5aa058b0a126a91887657046276688a05ad84e0f2359f25011034098fb0ba
Jul 07 18:50:06.071547 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.071512    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f522df3_b6d9_4e6f_a838_c17958c067c4.slice/crio-1788c0f019b560840c5450a0ded0af0e467aadb0a7b756dd7d7415113f3b2e7d WatchSource:0}: Error finding container 1788c0f019b560840c5450a0ded0af0e467aadb0a7b756dd7d7415113f3b2e7d: Status 404 returned error can't find the container with id 1788c0f019b560840c5450a0ded0af0e467aadb0a7b756dd7d7415113f3b2e7d
Jul 07 18:50:06.076468 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.076451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crb9r"
Jul 07 18:50:06.082992 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.082974    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5551bdd5_abf7_4125_a584_84e6cf547394.slice/crio-2fb48cc94545249f8e6c42eb263e03cea520bcbc1e8dda945c4cb795a67f4081 WatchSource:0}: Error finding container 2fb48cc94545249f8e6c42eb263e03cea520bcbc1e8dda945c4cb795a67f4081: Status 404 returned error can't find the container with id 2fb48cc94545249f8e6c42eb263e03cea520bcbc1e8dda945c4cb795a67f4081
Jul 07 18:50:06.092693 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.092677    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jx7p"
Jul 07 18:50:06.098986 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.098965    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140597b9_f015_41b7_863d_e780e413f042.slice/crio-c94d87157e36fbc730189e0ab4275395243235db203c56a40c5f6206d05eefcc WatchSource:0}: Error finding container c94d87157e36fbc730189e0ab4275395243235db203c56a40c5f6206d05eefcc: Status 404 returned error can't find the container with id c94d87157e36fbc730189e0ab4275395243235db203c56a40c5f6206d05eefcc
Jul 07 18:50:06.105925 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.105910    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qj68x"
Jul 07 18:50:06.109706 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.109687    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4ngsq"
Jul 07 18:50:06.112318 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.112298    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461b6e43_3eb4_437e_99a6_9675ea6c3e16.slice/crio-12e058729e88738e2cc3436b1f8c363b404126ad53a11256f2dcd64c0267ab57 WatchSource:0}: Error finding container 12e058729e88738e2cc3436b1f8c363b404126ad53a11256f2dcd64c0267ab57: Status 404 returned error can't find the container with id 12e058729e88738e2cc3436b1f8c363b404126ad53a11256f2dcd64c0267ab57
Jul 07 18:50:06.116821 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.116805    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab075a0_179b_4731_b520_a770bd0d876c.slice/crio-6564f6342433eed7a0122a3cbd7bb90dcc5220dd4df34a9acacfc6569535eee5 WatchSource:0}: Error finding container 6564f6342433eed7a0122a3cbd7bb90dcc5220dd4df34a9acacfc6569535eee5: Status 404 returned error can't find the container with id 6564f6342433eed7a0122a3cbd7bb90dcc5220dd4df34a9acacfc6569535eee5
Jul 07 18:50:06.344349 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.344269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:06.344349 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.344308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:06.344598 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.344406    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:06.344598 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.344434    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:06.344598 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.344474    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret podName:5d65a8f1-ab8f-46d0-a54b-aebd01376b95 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:07.344461582 +0000 UTC m=+3.110568933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret") pod "global-pull-secret-syncer-hrwfd" (UID: "5d65a8f1-ab8f-46d0-a54b-aebd01376b95") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:06.344598 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.344488    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs podName:7230ed43-8af3-4249-8e93-7045e0921ce2 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:07.344480836 +0000 UTC m=+3.110588187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs") pod "network-metrics-daemon-ftpks" (UID: "7230ed43-8af3-4249-8e93-7045e0921ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:06.375025 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.375005    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeda4633_f0ab_4f08_8926_47a5bf7a7c1d.slice/crio-d95503717fd5de170e585c19b03f9d667494a1898471590761b43c0f65e0e903 WatchSource:0}: Error finding container d95503717fd5de170e585c19b03f9d667494a1898471590761b43c0f65e0e903: Status 404 returned error can't find the container with id d95503717fd5de170e585c19b03f9d667494a1898471590761b43c0f65e0e903
Jul 07 18:50:06.386467 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:06.386442    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a09e90_3ebf_4269_a4c9_46151364434c.slice/crio-34bb9c5d34fe036c1f12d24d1c62de8ce21633830140cf0f6a27a769eb3afaa9 WatchSource:0}: Error finding container 34bb9c5d34fe036c1f12d24d1c62de8ce21633830140cf0f6a27a769eb3afaa9: Status 404 returned error can't find the container with id 34bb9c5d34fe036c1f12d24d1c62de8ce21633830140cf0f6a27a769eb3afaa9
Jul 07 18:50:06.391284 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.391268    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:06.445474 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.445453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:06.445622 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.445606    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:06.445666 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.445626    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:06.445666 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.445635    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rxjm2 for pod openshift-network-diagnostics/network-check-target-59xj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:06.445724 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.445681    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2 podName:fabc8876-768c-4139-86a3-eaef84dba62c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:07.44566486 +0000 UTC m=+3.211772214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxjm2" (UniqueName: "kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2") pod "network-check-target-59xj2" (UID: "fabc8876-768c-4139-86a3-eaef84dba62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:06.778518 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.778440    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:06.787043 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.786989    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:45:05 +0000 UTC" deadline="2027-12-02 21:13:14.531445321 +0000 UTC"
Jul 07 18:50:06.787043 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.787016    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12314h23m7.744433602s"
Jul 07 18:50:07.000199 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:06.999588    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:07.000199 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:06.999725    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:07.000199 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.000012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:07.000199 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.000120    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:07.042548 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.042448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz" event={"ID":"35a09e90-3ebf-4269-a4c9-46151364434c","Type":"ContainerStarted","Data":"34bb9c5d34fe036c1f12d24d1c62de8ce21633830140cf0f6a27a769eb3afaa9"}
Jul 07 18:50:07.071427 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.068852    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:07.071751 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.071638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"d95503717fd5de170e585c19b03f9d667494a1898471590761b43c0f65e0e903"}
Jul 07 18:50:07.087137 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.087048    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" event={"ID":"bab075a0-179b-4731-b520-a770bd0d876c","Type":"ContainerStarted","Data":"6564f6342433eed7a0122a3cbd7bb90dcc5220dd4df34a9acacfc6569535eee5"}
Jul 07 18:50:07.109033 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.108930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crb9r" event={"ID":"5551bdd5-abf7-4125-a584-84e6cf547394","Type":"ContainerStarted","Data":"2fb48cc94545249f8e6c42eb263e03cea520bcbc1e8dda945c4cb795a67f4081"}
Jul 07 18:50:07.129631 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.129447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8w5xp" event={"ID":"bbaf2cd6-c6bb-46bf-9540-c056445ce658","Type":"ContainerStarted","Data":"44f57df95c4475ef0f6b58c02a3b3b8520a5602dd8d7a9559672b7b96d81a462"}
Jul 07 18:50:07.139673 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.139596    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" event={"ID":"1031a34e2c9fcb7ef3b4306f0e919116","Type":"ContainerStarted","Data":"1ce735c0d432838e930c15988f01b947cba12b64b7461557d2b9fe31651499c0"}
Jul 07 18:50:07.158497 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.158472    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qj68x" event={"ID":"461b6e43-3eb4-437e-99a6-9675ea6c3e16","Type":"ContainerStarted","Data":"12e058729e88738e2cc3436b1f8c363b404126ad53a11256f2dcd64c0267ab57"}
Jul 07 18:50:07.175427 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.175393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jx7p" event={"ID":"140597b9-f015-41b7-863d-e780e413f042","Type":"ContainerStarted","Data":"c94d87157e36fbc730189e0ab4275395243235db203c56a40c5f6206d05eefcc"}
Jul 07 18:50:07.186365 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.186338    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k86x9" event={"ID":"0f522df3-b6d9-4e6f-a838-c17958c067c4","Type":"ContainerStarted","Data":"1788c0f019b560840c5450a0ded0af0e467aadb0a7b756dd7d7415113f3b2e7d"}
Jul 07 18:50:07.201999 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.201974    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6zd52" event={"ID":"5a38c374-ad30-41f0-a749-58add7354c77","Type":"ContainerStarted","Data":"e7f5aa058b0a126a91887657046276688a05ad84e0f2359f25011034098fb0ba"}
Jul 07 18:50:07.226889 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.226862    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" event={"ID":"abaeec0cb4dabc388094eb80c5e741b9","Type":"ContainerStarted","Data":"50ef4408d80d742741f4d882f57a83cf79bf0ddaa4d0ce8e6b877c7e72b2277e"}
Jul 07 18:50:07.352730 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.352653    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:07.352730 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.352719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:07.352940 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.352863    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:07.352940 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.352923    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret podName:5d65a8f1-ab8f-46d0-a54b-aebd01376b95 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:09.352904307 +0000 UTC m=+5.119011660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret") pod "global-pull-secret-syncer-hrwfd" (UID: "5d65a8f1-ab8f-46d0-a54b-aebd01376b95") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:07.353345 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.353326    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:07.353484 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.353382    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs podName:7230ed43-8af3-4249-8e93-7045e0921ce2 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:09.353366666 +0000 UTC m=+5.119474020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs") pod "network-metrics-daemon-ftpks" (UID: "7230ed43-8af3-4249-8e93-7045e0921ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:07.455488 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.453731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:07.455488 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.453928    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:07.455488 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.453949    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:07.455488 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.453961    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rxjm2 for pod openshift-network-diagnostics/network-check-target-59xj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:07.455488 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.454014    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2 podName:fabc8876-768c-4139-86a3-eaef84dba62c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:09.453997222 +0000 UTC m=+5.220104584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxjm2" (UniqueName: "kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2") pod "network-check-target-59xj2" (UID: "fabc8876-768c-4139-86a3-eaef84dba62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:07.787356 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.787244    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:45:05 +0000 UTC" deadline="2028-03-22 00:28:08.131567876 +0000 UTC"
Jul 07 18:50:07.787356 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.787309    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14957h38m0.344263858s"
Jul 07 18:50:07.998559 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:07.998527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:07.998720 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:07.998639    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:09.000899 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:09.000863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:09.001433 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.000990    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:09.001433 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:09.001251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:09.001433 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.001368    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:09.367145 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:09.367061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:09.367316 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:09.367142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:09.367395 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.367358    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:09.367513 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.367499    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:09.367595 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.367553    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret podName:5d65a8f1-ab8f-46d0-a54b-aebd01376b95 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:13.36739961 +0000 UTC m=+9.133506966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret") pod "global-pull-secret-syncer-hrwfd" (UID: "5d65a8f1-ab8f-46d0-a54b-aebd01376b95") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:09.367595 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.367573    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs podName:7230ed43-8af3-4249-8e93-7045e0921ce2 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:13.367562009 +0000 UTC m=+9.133669365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs") pod "network-metrics-daemon-ftpks" (UID: "7230ed43-8af3-4249-8e93-7045e0921ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:09.468462 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:09.467810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:09.468462 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.468007    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:09.468462 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.468027    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:09.468462 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.468039    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rxjm2 for pod openshift-network-diagnostics/network-check-target-59xj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:09.468462 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.468097    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2 podName:fabc8876-768c-4139-86a3-eaef84dba62c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:13.46807977 +0000 UTC m=+9.234187137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxjm2" (UniqueName: "kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2") pod "network-check-target-59xj2" (UID: "fabc8876-768c-4139-86a3-eaef84dba62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:09.998893 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:09.998862    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:09.999081 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:09.999003    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:10.999720 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:10.999673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:11.000152 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:10.999673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:11.000152 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:10.999828    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:11.000152 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:10.999884    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:11.999640 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:11.999593    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:11.999826 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:11.999733    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:12.999304 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:12.999274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:12.999543 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:12.999274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:12.999543 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:12.999394    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:12.999543 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:12.999522    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:13.399304 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:13.398511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:13.399304 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:13.398567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:13.399304 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.398684    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:13.399304 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.398741    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret podName:5d65a8f1-ab8f-46d0-a54b-aebd01376b95 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:21.398722593 +0000 UTC m=+17.164829950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret") pod "global-pull-secret-syncer-hrwfd" (UID: "5d65a8f1-ab8f-46d0-a54b-aebd01376b95") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:13.399304 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.399176    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:13.399304 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.399227    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs podName:7230ed43-8af3-4249-8e93-7045e0921ce2 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:21.399210589 +0000 UTC m=+17.165317944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs") pod "network-metrics-daemon-ftpks" (UID: "7230ed43-8af3-4249-8e93-7045e0921ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:13.499793 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:13.499765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:13.499952 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.499905    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:13.499952 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.499925    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:13.499952 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.499934    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rxjm2 for pod openshift-network-diagnostics/network-check-target-59xj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:13.500082 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.499982    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2 podName:fabc8876-768c-4139-86a3-eaef84dba62c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:21.499969647 +0000 UTC m=+17.266077002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxjm2" (UniqueName: "kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2") pod "network-check-target-59xj2" (UID: "fabc8876-768c-4139-86a3-eaef84dba62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:13.999153 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:13.999125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:13.999355 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:13.999261    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:15.000271 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:15.000233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:15.000741 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:15.000357    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:15.001054 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:15.000878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:15.001054 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:15.000990    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:15.998655 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:15.998620    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:15.998855 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:15.998762    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:17.000050 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:16.999457    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:17.000050 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:16.999652    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:17.000050 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:16.999472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:17.000774 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:17.000119    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:17.999343 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:17.999313    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:17.999533 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:17.999444    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:18.999467 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:18.999437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:18.999916 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:18.999570    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:18.999916 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:18.999626    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:18.999916 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:18.999754    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:19.999010 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:19.998978    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:19.999194 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:19.999098    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:20.999534 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:20.999396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:20.999962 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:20.999551    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:20.999962 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:20.999612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:20.999962 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:20.999703    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:21.458654 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:21.458618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:21.458843 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:21.458673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:21.458843 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.458770    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:21.458961 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.458837    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs podName:7230ed43-8af3-4249-8e93-7045e0921ce2 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.458819756 +0000 UTC m=+33.224927108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs") pod "network-metrics-daemon-ftpks" (UID: "7230ed43-8af3-4249-8e93-7045e0921ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:21.458961 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.458777    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:21.458961 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.458930    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret podName:5d65a8f1-ab8f-46d0-a54b-aebd01376b95 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.458908706 +0000 UTC m=+33.225016067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret") pod "global-pull-secret-syncer-hrwfd" (UID: "5d65a8f1-ab8f-46d0-a54b-aebd01376b95") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:21.559881 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:21.559800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:21.560037 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.559940    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:21.560037 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.559964    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:21.560037 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.559976    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rxjm2 for pod openshift-network-diagnostics/network-check-target-59xj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:21.560177 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.560037    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2 podName:fabc8876-768c-4139-86a3-eaef84dba62c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.560018204 +0000 UTC m=+33.326125557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxjm2" (UniqueName: "kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2") pod "network-check-target-59xj2" (UID: "fabc8876-768c-4139-86a3-eaef84dba62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:21.998717 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:21.998651    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:21.998864 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:21.998762    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:22.999260 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:22.999220    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:22.999757 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:22.999380    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:22.999757 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:22.999438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:22.999757 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:22.999535    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:23.998940 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:23.998906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:23.999085 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:23.999036    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:24.999137 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:24.999106    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:24.999573 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:24.999210    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:24.999573 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:24.999319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:24.999573 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:24.999452    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:26.000036 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:25.999497    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:26.000036 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:25.999889    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:26.270443 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.270407    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 18:50:26.270771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.270751    2577 generic.go:356] "Generic (PLEG): container finished" podID="eeda4633-f0ab-4f08-8926-47a5bf7a7c1d" containerID="19efe97dcef02501592217d638699623faca90d8c5504801f41f5a10dcff65d5" exitCode=1
Jul 07 18:50:26.270823 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.270810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"ab993e771bdbb980bc23bec6b433d502a260896dc25efc35133b3d2da050f3b6"}
Jul 07 18:50:26.270906 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.270893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"e48fa07745f19fd9268a3939c440de66b3350899af4ae0eb341a4a5ece369596"}
Jul 07 18:50:26.270940 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.270931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"8f5be0e43f2160ac72c9f7f5ad06e1aedc57a841f57f0f0b2c1c3538faea6078"}
Jul 07 18:50:26.270979 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.270960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerDied","Data":"19efe97dcef02501592217d638699623faca90d8c5504801f41f5a10dcff65d5"}
Jul 07 18:50:26.271020 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.270998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"7b54d44d905a3db4f4b425b91629c631a3d5976afb5c9615053b26c63c8c77ab"}
Jul 07 18:50:26.272111 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.272090    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" event={"ID":"1031a34e2c9fcb7ef3b4306f0e919116","Type":"ContainerStarted","Data":"f8bf90efcd39e3c466e08e3dfbdcd23919a7f56d5a1811a78fb3363a325a449f"}
Jul 07 18:50:26.273407 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.273391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jx7p" event={"ID":"140597b9-f015-41b7-863d-e780e413f042","Type":"ContainerStarted","Data":"5348f406bce226a68bff5717ec1dce6d76531b3a88bec211db8daa6945426bbd"}
Jul 07 18:50:26.274712 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.274694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k86x9" event={"ID":"0f522df3-b6d9-4e6f-a838-c17958c067c4","Type":"ContainerStarted","Data":"9a4e86b179c83de39e0e97d1fae1af863536f3dd047a5718f30877ac3d3111cc"}
Jul 07 18:50:26.287357 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.287323    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-228.ec2.internal" podStartSLOduration=21.287313259 podStartE2EDuration="21.287313259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:26.287237567 +0000 UTC m=+22.053344941" watchObservedRunningTime="2026-07-07 18:50:26.287313259 +0000 UTC m=+22.053420632"
Jul 07 18:50:26.321892 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.321856    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k86x9" podStartSLOduration=1.806711103 podStartE2EDuration="21.32184336s" totalImagesPullingTime="19.515132257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:26.305199991 +0000 UTC m=+22.071307365" watchObservedRunningTime="2026-07-07 18:50:26.32184336 +0000 UTC m=+22.087950733"
Jul 07 18:50:26.322010 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.321993    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4jx7p" podStartSLOduration=1.50804763 podStartE2EDuration="21.321987637s" totalImagesPullingTime="19.813940007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:26.321665086 +0000 UTC m=+22.087772458" watchObservedRunningTime="2026-07-07 18:50:26.321987637 +0000 UTC m=+22.088095009"
Jul 07 18:50:26.999387 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.999207    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:26.999517 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:26.999210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:26.999517 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:26.999484    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:26.999812 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:26.999534    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:27.278463 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.278369    2577 generic.go:356] "Generic (PLEG): container finished" podID="abaeec0cb4dabc388094eb80c5e741b9" containerID="92007d57a4a63fe047e893c58eb9ce06c5ab5580e8105e90036bdbacc1ee597e" exitCode=0
Jul 07 18:50:27.278463 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.278449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" event={"ID":"abaeec0cb4dabc388094eb80c5e741b9","Type":"ContainerDied","Data":"92007d57a4a63fe047e893c58eb9ce06c5ab5580e8105e90036bdbacc1ee597e"}
Jul 07 18:50:27.280187 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.280152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz" event={"ID":"35a09e90-3ebf-4269-a4c9-46151364434c","Type":"ContainerStarted","Data":"8473881e6199256d6206f7538fda233fe17acafe9efde90e93a831b7eb3c3958"}
Jul 07 18:50:27.283427 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.283393    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 18:50:27.283831 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.283799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"d2f006cca1cc8855ab93ada07eadc600f023b2f62ddc389eb5c8bda60842ad00"}
Jul 07 18:50:27.285225 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.285202    2577 generic.go:356] "Generic (PLEG): container finished" podID="bab075a0-179b-4731-b520-a770bd0d876c" containerID="d1620d6cfaada5ec8c8cf44e136d85eb9b61206d94b1b3c9aa314bc1b740932a" exitCode=0
Jul 07 18:50:27.285327 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.285264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" event={"ID":"bab075a0-179b-4731-b520-a770bd0d876c","Type":"ContainerDied","Data":"d1620d6cfaada5ec8c8cf44e136d85eb9b61206d94b1b3c9aa314bc1b740932a"}
Jul 07 18:50:27.287015 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.286991    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crb9r" event={"ID":"5551bdd5-abf7-4125-a584-84e6cf547394","Type":"ContainerStarted","Data":"c87dd862dcbfab1362c600fc29a27c519c30048d1db3e0d43a5de258035bdfaa"}
Jul 07 18:50:27.288858 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.288831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8w5xp" event={"ID":"bbaf2cd6-c6bb-46bf-9540-c056445ce658","Type":"ContainerStarted","Data":"12fa24807b7465cd6dd65da4649c5f9826cc3ec7133b43520bad1652b0cdb302"}
Jul 07 18:50:27.290736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.290714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qj68x" event={"ID":"461b6e43-3eb4-437e-99a6-9675ea6c3e16","Type":"ContainerStarted","Data":"968e411b592fb6fe331a5d8fbf591e8e3fce66bf884e8a8ab3011c8aa1da9abe"}
Jul 07 18:50:27.292266 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.292245    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6zd52" event={"ID":"5a38c374-ad30-41f0-a749-58add7354c77","Type":"ContainerStarted","Data":"6963715cea9d5101e15e8e29bea9b8be9b843a22d5971bf94755e333f79e7edd"}
Jul 07 18:50:27.310609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.310573    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-crb9r" podStartSLOduration=2.777265947 podStartE2EDuration="22.310560953s" totalImagesPullingTime="19.533295006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:27.310007412 +0000 UTC m=+23.076114786" watchObservedRunningTime="2026-07-07 18:50:27.310560953 +0000 UTC m=+23.076668326"
Jul 07 18:50:27.347447 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.347390    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8w5xp" podStartSLOduration=2.803232189 podStartE2EDuration="22.347376197s" totalImagesPullingTime="19.544144008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:27.347262618 +0000 UTC m=+23.113369995" watchObservedRunningTime="2026-07-07 18:50:27.347376197 +0000 UTC m=+23.113483572"
Jul 07 18:50:27.361915 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.361874    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qj68x" podStartSLOduration=2.858148761 podStartE2EDuration="22.361850868s" totalImagesPullingTime="19.503702107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:27.361761808 +0000 UTC m=+23.127869184" watchObservedRunningTime="2026-07-07 18:50:27.361850868 +0000 UTC m=+23.127958244"
Jul 07 18:50:27.382315 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.382186    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6zd52" podStartSLOduration=2.833999099 podStartE2EDuration="22.382167575s" totalImagesPullingTime="19.548168476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:27.381718884 +0000 UTC m=+23.147826258" watchObservedRunningTime="2026-07-07 18:50:27.382167575 +0000 UTC m=+23.148274948"
Jul 07 18:50:27.999345 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:27.999327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:27.999451 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:27.999431    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:28.057181 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.057147    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 18:50:28.297225 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.297151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" event={"ID":"abaeec0cb4dabc388094eb80c5e741b9","Type":"ContainerStarted","Data":"481e616d7b18db4a855af70c6744d1485e92514b361d838957f8eee2385b8e71"}
Jul 07 18:50:28.299604 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.299506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz" event={"ID":"35a09e90-3ebf-4269-a4c9-46151364434c","Type":"ContainerStarted","Data":"d048c5dc6cb717d890aeda67bb1213e097fe17483565fd15de154c153e2316b7"}
Jul 07 18:50:28.314994 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.314956    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-228.ec2.internal" podStartSLOduration=23.314942441 podStartE2EDuration="23.314942441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:28.314807785 +0000 UTC m=+24.080915157" watchObservedRunningTime="2026-07-07 18:50:28.314942441 +0000 UTC m=+24.081049814"
Jul 07 18:50:28.872673 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.872583    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T18:50:28.057166777Z","UUID":"1b493a9a-a324-4db0-bc76-a59900173be2","Handler":null,"Name":"","Endpoint":""}
Jul 07 18:50:28.874262 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.874239    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 18:50:28.874381 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.874285    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 18:50:28.999335 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.999307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:28.999510 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:28.999319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:28.999510 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:28.999462    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:28.999628 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:28.999541    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:29.041089 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.041055    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:29.156609 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.156584    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:29.220035 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.219999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:29.303382 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.303352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz" event={"ID":"35a09e90-3ebf-4269-a4c9-46151364434c","Type":"ContainerStarted","Data":"b6a2815b991c50157706b33baf38c504a5ce9fbea1fc52b4c5cecde403a773e4"}
Jul 07 18:50:29.306296 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.306276    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 18:50:29.306707 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.306685    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"14ab32833ef95a26363d00a7392f56435e7d19d4a6607b607544f8e594dab0ba"}
Jul 07 18:50:29.322082 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.322035    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-758mz" podStartSLOduration=3.6502823170000003 podStartE2EDuration="25.32201792s" totalImagesPullingTime="21.671735603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:29.321946807 +0000 UTC m=+25.088054180" watchObservedRunningTime="2026-07-07 18:50:29.32201792 +0000 UTC m=+25.088125295"
Jul 07 18:50:29.800758 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.800721    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:29.864259 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.864229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:29.999277 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:29.999249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:29.999453 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:29.999375    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:30.200296 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:30.200224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:30.257551 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:30.257520    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:30.998929 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:30.998704    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:30.999462 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:30.998757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:30.999462 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:30.998993    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:30.999462 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:30.999059    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:31.109711 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.109681    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:31.110318 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.110303    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:31.315503 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.315433    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 18:50:31.315849 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.315819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"4d24f3e70987859d5b7edeb21ca9a8775696d72ab340621da5c8dca78c24d495"}
Jul 07 18:50:31.316038 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.316018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:31.316435 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.316403    2577 scope.go:117] "RemoveContainer" containerID="19efe97dcef02501592217d638699623faca90d8c5504801f41f5a10dcff65d5"
Jul 07 18:50:31.316511 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.316491    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6zd52"
Jul 07 18:50:31.422594 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.422569    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:31.999215 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:31.999182    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:31.999886 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:31.999290    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:32.041469 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.041441    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:32.147060 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.147027    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:32.322355 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.322277    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 18:50:32.322743 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.322716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" event={"ID":"eeda4633-f0ab-4f08-8926-47a5bf7a7c1d","Type":"ContainerStarted","Data":"eeb2d7f42021711bd2b2f645eb83a1fc551b6534cb0be0784a63618244429330"}
Jul 07 18:50:32.322861 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.322825    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 18:50:32.323217 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.323191    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:32.323323 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.323275    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:32.340943 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.340918    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:32.341111 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.341098    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:32.356705 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.356655    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" podStartSLOduration=9.073447644 podStartE2EDuration="28.356639884s" totalImagesPullingTime="19.28319224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:32.356550659 +0000 UTC m=+28.122658033" watchObservedRunningTime="2026-07-07 18:50:32.356639884 +0000 UTC m=+28.122747254"
Jul 07 18:50:32.482907 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.482863    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:32.583638 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.583563    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:32.912035 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.911780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrwfd"]
Jul 07 18:50:32.912190 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.912080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:32.912190 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:32.912178    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:32.915629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.915406    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ftpks"]
Jul 07 18:50:32.915629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.915538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:32.915820 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:32.915633    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:32.916239 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.916215    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-59xj2"]
Jul 07 18:50:32.916350 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:32.916317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:32.916450 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:32.916405    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:33.325188 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:33.325158    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 18:50:33.438954 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:33.438924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:33.504277 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:33.504255    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:33.841265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:33.841246    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:50:34.328376 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:34.328343    2577 generic.go:356] "Generic (PLEG): container finished" podID="bab075a0-179b-4731-b520-a770bd0d876c" containerID="9f07d71cef42a54744da357924fc67eb98a317153d345f9c46473198a5ee5149" exitCode=0
Jul 07 18:50:34.328906 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:34.328443    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" event={"ID":"bab075a0-179b-4731-b520-a770bd0d876c","Type":"ContainerDied","Data":"9f07d71cef42a54744da357924fc67eb98a317153d345f9c46473198a5ee5149"}
Jul 07 18:50:35.000241 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:35.000208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:35.000426 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:35.000287    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:35.000426 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:35.000387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:35.000551 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:35.000514    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:35.000551 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:35.000549    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:35.000681 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:35.000646    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:35.342876 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:35.342832    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg" podUID="eeda4633-f0ab-4f08-8926-47a5bf7a7c1d" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 07 18:50:36.334706 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:36.334673    2577 generic.go:356] "Generic (PLEG): container finished" podID="bab075a0-179b-4731-b520-a770bd0d876c" containerID="acb05229fb52c759fcf8b52ce2f4cd53250993d8ca5e9fe6ab2a88e7409d57f3" exitCode=0
Jul 07 18:50:36.334859 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:36.334728    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" event={"ID":"bab075a0-179b-4731-b520-a770bd0d876c","Type":"ContainerDied","Data":"acb05229fb52c759fcf8b52ce2f4cd53250993d8ca5e9fe6ab2a88e7409d57f3"}
Jul 07 18:50:36.998903 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:36.998869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:36.999285 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:36.998919    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:36.999285 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:36.998874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:36.999285 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:36.999024    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrwfd" podUID="5d65a8f1-ab8f-46d0-a54b-aebd01376b95"
Jul 07 18:50:36.999285 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:36.999109    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftpks" podUID="7230ed43-8af3-4249-8e93-7045e0921ce2"
Jul 07 18:50:36.999285 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:36.999208    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59xj2" podUID="fabc8876-768c-4139-86a3-eaef84dba62c"
Jul 07 18:50:37.481771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:37.481740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:37.481924 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:37.481777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:37.481924 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:37.481873    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:37.481924 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:37.481880    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:37.481924 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:37.481918    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret podName:5d65a8f1-ab8f-46d0-a54b-aebd01376b95 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:09.481905639 +0000 UTC m=+65.248012990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret") pod "global-pull-secret-syncer-hrwfd" (UID: "5d65a8f1-ab8f-46d0-a54b-aebd01376b95") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:37.482059 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:37.481932    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs podName:7230ed43-8af3-4249-8e93-7045e0921ce2 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:09.481925533 +0000 UTC m=+65.248032884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs") pod "network-metrics-daemon-ftpks" (UID: "7230ed43-8af3-4249-8e93-7045e0921ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:37.582119 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:37.582095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:37.582252 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:37.582216    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:37.582252 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:37.582229    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:37.582252 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:37.582237    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rxjm2 for pod openshift-network-diagnostics/network-check-target-59xj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:37.582429 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:37.582276    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2 podName:fabc8876-768c-4139-86a3-eaef84dba62c nodeName:}" failed. No retries permitted until 2026-07-07 18:51:09.582264977 +0000 UTC m=+65.348372327 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxjm2" (UniqueName: "kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2") pod "network-check-target-59xj2" (UID: "fabc8876-768c-4139-86a3-eaef84dba62c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:38.341261 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.341038    2577 generic.go:356] "Generic (PLEG): container finished" podID="bab075a0-179b-4731-b520-a770bd0d876c" containerID="53260a89e31805049888cf1d4b7c3cc7c3bd7969be5737a61bb29c2acf3f71b6" exitCode=0
Jul 07 18:50:38.341561 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.341112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" event={"ID":"bab075a0-179b-4731-b520-a770bd0d876c","Type":"ContainerDied","Data":"53260a89e31805049888cf1d4b7c3cc7c3bd7969be5737a61bb29c2acf3f71b6"}
Jul 07 18:50:38.538645 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.538628    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-228.ec2.internal" event="NodeReady"
Jul 07 18:50:38.538742 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.538724    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 18:50:38.584156 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.584087    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b5cc8dccf-6phqn"]
Jul 07 18:50:38.597094 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.597076    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qbhpz"]
Jul 07 18:50:38.597210 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.597194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.600748 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.600724    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 18:50:38.600992 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.600971    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 18:50:38.601462 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.601364    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 18:50:38.602005 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.601969    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wb95j\""
Jul 07 18:50:38.606346 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.606328    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 18:50:38.611140 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.611123    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n8jnp"]
Jul 07 18:50:38.611268 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.611251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qbhpz"
Jul 07 18:50:38.615593 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.615576    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 18:50:38.615932 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.615914    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 18:50:38.616125 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.615940    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 18:50:38.616528 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.616009    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-45jgr\""
Jul 07 18:50:38.627218 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.627200    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b5cc8dccf-6phqn"]
Jul 07 18:50:38.627297 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.627229    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qbhpz"]
Jul 07 18:50:38.627297 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.627244    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n8jnp"]
Jul 07 18:50:38.627372 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.627320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.629958 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.629938    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 18:50:38.630037 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.629960    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 18:50:38.630037 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.629962    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b4nbt\""
Jul 07 18:50:38.689144 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e3a5c49-400c-4550-888b-87f763daca59-ca-trust-extracted\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.689276 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-trusted-ca\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.689276 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eddf42a-b931-44a5-8b14-c18b6ef4fd59-cert\") pod \"ingress-canary-qbhpz\" (UID: \"0eddf42a-b931-44a5-8b14-c18b6ef4fd59\") " pod="openshift-ingress-canary/ingress-canary-qbhpz"
Jul 07 18:50:38.689276 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689199    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ceefaf-6695-46d9-b707-e4f0cd270c98-tmp-dir\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.689276 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-image-registry-private-configuration\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.689402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689294    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.689402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-registry-certificates\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.689402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-installation-pull-secrets\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.689402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-bound-sa-token\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.689613 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7cw\" (UniqueName: \"kubernetes.io/projected/0eddf42a-b931-44a5-8b14-c18b6ef4fd59-kube-api-access-2z7cw\") pod \"ingress-canary-qbhpz\" (UID: \"0eddf42a-b931-44a5-8b14-c18b6ef4fd59\") " pod="openshift-ingress-canary/ingress-canary-qbhpz"
Jul 07 18:50:38.689613 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689464    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.689613 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmrnj\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-kube-api-access-rmrnj\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.689613 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ceefaf-6695-46d9-b707-e4f0cd270c98-config-volume\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.689613 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.689560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xz8n\" (UniqueName: \"kubernetes.io/projected/c7ceefaf-6695-46d9-b707-e4f0cd270c98-kube-api-access-6xz8n\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.790367 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.790505 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-registry-certificates\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.790505 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-installation-pull-secrets\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.790505 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-bound-sa-token\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.790505 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7cw\" (UniqueName: \"kubernetes.io/projected/0eddf42a-b931-44a5-8b14-c18b6ef4fd59-kube-api-access-2z7cw\") pod \"ingress-canary-qbhpz\" (UID: \"0eddf42a-b931-44a5-8b14-c18b6ef4fd59\") " pod="openshift-ingress-canary/ingress-canary-qbhpz"
Jul 07 18:50:38.790505 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.790753 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmrnj\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-kube-api-access-rmrnj\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.790753 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ceefaf-6695-46d9-b707-e4f0cd270c98-config-volume\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.790753 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xz8n\" (UniqueName: \"kubernetes.io/projected/c7ceefaf-6695-46d9-b707-e4f0cd270c98-kube-api-access-6xz8n\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.790753 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e3a5c49-400c-4550-888b-87f763daca59-ca-trust-extracted\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.790753 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-trusted-ca\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.790753 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:38.790704    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:50:38.790753 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:38.790722    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5cc8dccf-6phqn: secret "image-registry-tls" not found
Jul 07 18:50:38.791057 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:38.790781    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls podName:5e3a5c49-400c-4550-888b-87f763daca59 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:39.290760611 +0000 UTC m=+35.056867980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls") pod "image-registry-7b5cc8dccf-6phqn" (UID: "5e3a5c49-400c-4550-888b-87f763daca59") : secret "image-registry-tls" not found
Jul 07 18:50:38.791057 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eddf42a-b931-44a5-8b14-c18b6ef4fd59-cert\") pod \"ingress-canary-qbhpz\" (UID: \"0eddf42a-b931-44a5-8b14-c18b6ef4fd59\") " pod="openshift-ingress-canary/ingress-canary-qbhpz"
Jul 07 18:50:38.791057 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ceefaf-6695-46d9-b707-e4f0cd270c98-tmp-dir\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.791057 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.790902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-image-registry-private-configuration\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.791255 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.791181    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e3a5c49-400c-4550-888b-87f763daca59-ca-trust-extracted\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.791309 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:38.791260    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:50:38.791309 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.791297    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-registry-certificates\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.791432 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:38.791325    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls podName:c7ceefaf-6695-46d9-b707-e4f0cd270c98 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:39.291307646 +0000 UTC m=+35.057414999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls") pod "dns-default-n8jnp" (UID: "c7ceefaf-6695-46d9-b707-e4f0cd270c98") : secret "dns-default-metrics-tls" not found
Jul 07 18:50:38.791432 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.791301    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ceefaf-6695-46d9-b707-e4f0cd270c98-config-volume\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.791520 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.791409    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ceefaf-6695-46d9-b707-e4f0cd270c98-tmp-dir\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.794667 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.794647    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-image-registry-private-configuration\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.794794 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.794774    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-installation-pull-secrets\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.794837 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.794812    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eddf42a-b931-44a5-8b14-c18b6ef4fd59-cert\") pod \"ingress-canary-qbhpz\" (UID: \"0eddf42a-b931-44a5-8b14-c18b6ef4fd59\") " pod="openshift-ingress-canary/ingress-canary-qbhpz"
Jul 07 18:50:38.804822 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.804794    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xz8n\" (UniqueName: \"kubernetes.io/projected/c7ceefaf-6695-46d9-b707-e4f0cd270c98-kube-api-access-6xz8n\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:38.804914 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.804820    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmrnj\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-kube-api-access-rmrnj\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.804914 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.804852    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7cw\" (UniqueName: \"kubernetes.io/projected/0eddf42a-b931-44a5-8b14-c18b6ef4fd59-kube-api-access-2z7cw\") pod \"ingress-canary-qbhpz\" (UID: \"0eddf42a-b931-44a5-8b14-c18b6ef4fd59\") " pod="openshift-ingress-canary/ingress-canary-qbhpz"
Jul 07 18:50:38.805396 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.805375    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-trusted-ca\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.805994 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.805974    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-bound-sa-token\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:38.920076 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.920024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qbhpz"
Jul 07 18:50:38.998887 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.998854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:50:38.999024 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.998855    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:50:38.999024 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:38.998995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:50:39.001871 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.001849    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:50:39.001983 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.001885    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:50:39.002205 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.002187    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cxlw6\""
Jul 07 18:50:39.002277 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.002216    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:50:39.002277 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.002223    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l98hl\""
Jul 07 18:50:39.002564 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.002543    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:50:39.122635 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.122607    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qbhpz"]
Jul 07 18:50:39.126256 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:39.126227    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eddf42a_b931_44a5_8b14_c18b6ef4fd59.slice/crio-e120b6db6e599af9d6f5e51305d52205781da07c44e2b32e79cca686b3409394 WatchSource:0}: Error finding container e120b6db6e599af9d6f5e51305d52205781da07c44e2b32e79cca686b3409394: Status 404 returned error can't find the container with id e120b6db6e599af9d6f5e51305d52205781da07c44e2b32e79cca686b3409394
Jul 07 18:50:39.295233 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.295202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:39.295381 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:39.295326    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:50:39.295381 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.295362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:39.295528 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:39.295396    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls podName:c7ceefaf-6695-46d9-b707-e4f0cd270c98 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:40.295372739 +0000 UTC m=+36.061480110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls") pod "dns-default-n8jnp" (UID: "c7ceefaf-6695-46d9-b707-e4f0cd270c98") : secret "dns-default-metrics-tls" not found
Jul 07 18:50:39.295528 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:39.295485    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:50:39.295528 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:39.295501    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5cc8dccf-6phqn: secret "image-registry-tls" not found
Jul 07 18:50:39.295663 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:39.295562    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls podName:5e3a5c49-400c-4550-888b-87f763daca59 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:40.295530893 +0000 UTC m=+36.061638269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls") pod "image-registry-7b5cc8dccf-6phqn" (UID: "5e3a5c49-400c-4550-888b-87f763daca59") : secret "image-registry-tls" not found
Jul 07 18:50:39.348515 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.348482    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qbhpz" event={"ID":"0eddf42a-b931-44a5-8b14-c18b6ef4fd59","Type":"ContainerStarted","Data":"e120b6db6e599af9d6f5e51305d52205781da07c44e2b32e79cca686b3409394"}
Jul 07 18:50:39.414834 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.414810    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:39.474519 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:39.474485    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:40.303937 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.303867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:40.304144 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.304036    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:50:40.304144 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.304046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:40.304144 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.304109    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls podName:c7ceefaf-6695-46d9-b707-e4f0cd270c98 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:42.304086014 +0000 UTC m=+38.070193369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls") pod "dns-default-n8jnp" (UID: "c7ceefaf-6695-46d9-b707-e4f0cd270c98") : secret "dns-default-metrics-tls" not found
Jul 07 18:50:40.304321 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.304165    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:50:40.304321 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.304180    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5cc8dccf-6phqn: secret "image-registry-tls" not found
Jul 07 18:50:40.304321 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.304237    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls podName:5e3a5c49-400c-4550-888b-87f763daca59 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:42.304219356 +0000 UTC m=+38.070326734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls") pod "image-registry-7b5cc8dccf-6phqn" (UID: "5e3a5c49-400c-4550-888b-87f763daca59") : secret "image-registry-tls" not found
Jul 07 18:50:40.438223 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.438188    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wqxgn"]
Jul 07 18:50:40.455537 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.455504    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wqxgn"]
Jul 07 18:50:40.455687 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.455635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.458403 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.458375    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 18:50:40.458669 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.458645    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 18:50:40.458779 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.458701    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lh7s7\""
Jul 07 18:50:40.459748 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.459731    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 18:50:40.459842 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.459769    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 18:50:40.494425 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.494381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:40.548307 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.548277    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh"]
Jul 07 18:50:40.563356 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.563259    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh"
Jul 07 18:50:40.564209 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.564145    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh"]
Jul 07 18:50:40.568540 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.568149    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 18:50:40.568540 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.568249    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jbq6l\""
Jul 07 18:50:40.568540 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.568251    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 18:50:40.607565 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.607539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a8f543a-7988-4530-a7b6-fa1e4415546a-crio-socket\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.607740 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.607580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a8f543a-7988-4530-a7b6-fa1e4415546a-data-volume\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.607740 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.607608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.607740 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.607642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.607904 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.607740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmjws\" (UniqueName: \"kubernetes.io/projected/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-api-access-kmjws\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.610821 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.610802    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:40.708315 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.708276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.708551 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.708327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kp5f\" (UniqueName: \"kubernetes.io/projected/b06eb2b9-81ca-47db-b4b1-a932d1812bd7-kube-api-access-2kp5f\") pod \"migrator-d57d58cc9-gb2zh\" (UID: \"b06eb2b9-81ca-47db-b4b1-a932d1812bd7\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh"
Jul 07 18:50:40.708551 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.708466    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:50:40.708551 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.708504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmjws\" (UniqueName: \"kubernetes.io/projected/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-api-access-kmjws\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.708551 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.708549    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm podName:5a8f543a-7988-4530-a7b6-fa1e4415546a nodeName:}" failed. No retries permitted until 2026-07-07 18:50:41.208528395 +0000 UTC m=+36.974635749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wqxgn" (UID: "5a8f543a-7988-4530-a7b6-fa1e4415546a") : configmap "kube-rbac-proxy" not found
Jul 07 18:50:40.708795 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.708605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a8f543a-7988-4530-a7b6-fa1e4415546a-crio-socket\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.708795 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.708638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a8f543a-7988-4530-a7b6-fa1e4415546a-data-volume\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.708795 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.708667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.708795 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.708778    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:40.708989 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:40.708850    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls podName:5a8f543a-7988-4530-a7b6-fa1e4415546a nodeName:}" failed. No retries permitted until 2026-07-07 18:50:41.208836917 +0000 UTC m=+36.974944272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxgn" (UID: "5a8f543a-7988-4530-a7b6-fa1e4415546a") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:40.708989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.708897    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a8f543a-7988-4530-a7b6-fa1e4415546a-crio-socket\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.709141 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.709121    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a8f543a-7988-4530-a7b6-fa1e4415546a-data-volume\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.718878 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.718852    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmjws\" (UniqueName: \"kubernetes.io/projected/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-api-access-kmjws\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:40.757200 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.757170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:40.809196 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.809156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kp5f\" (UniqueName: \"kubernetes.io/projected/b06eb2b9-81ca-47db-b4b1-a932d1812bd7-kube-api-access-2kp5f\") pod \"migrator-d57d58cc9-gb2zh\" (UID: \"b06eb2b9-81ca-47db-b4b1-a932d1812bd7\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh"
Jul 07 18:50:40.819117 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.819056    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kp5f\" (UniqueName: \"kubernetes.io/projected/b06eb2b9-81ca-47db-b4b1-a932d1812bd7-kube-api-access-2kp5f\") pod \"migrator-d57d58cc9-gb2zh\" (UID: \"b06eb2b9-81ca-47db-b4b1-a932d1812bd7\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh"
Jul 07 18:50:40.874051 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:40.874022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh"
Jul 07 18:50:41.030543 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.030513    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh"]
Jul 07 18:50:41.033195 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:41.033172    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06eb2b9_81ca_47db_b4b1_a932d1812bd7.slice/crio-e734364bdbab500b56c074950e0f8e4c754ddea7d2cdde263743cb077b171fc7 WatchSource:0}: Error finding container e734364bdbab500b56c074950e0f8e4c754ddea7d2cdde263743cb077b171fc7: Status 404 returned error can't find the container with id e734364bdbab500b56c074950e0f8e4c754ddea7d2cdde263743cb077b171fc7
Jul 07 18:50:41.041984 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.041960    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:41.144087 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.143910    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:41.212097 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.212062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:41.212287 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.212113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:41.212287 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:41.212212    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:41.212287 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:41.212224    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:50:41.212287 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:41.212272    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls podName:5a8f543a-7988-4530-a7b6-fa1e4415546a nodeName:}" failed. No retries permitted until 2026-07-07 18:50:42.212254929 +0000 UTC m=+37.978362283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxgn" (UID: "5a8f543a-7988-4530-a7b6-fa1e4415546a") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:41.212287 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:41.212288    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm podName:5a8f543a-7988-4530-a7b6-fa1e4415546a nodeName:}" failed. No retries permitted until 2026-07-07 18:50:42.212280146 +0000 UTC m=+37.978387497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wqxgn" (UID: "5a8f543a-7988-4530-a7b6-fa1e4415546a") : configmap "kube-rbac-proxy" not found
Jul 07 18:50:41.355069 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.355021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh" event={"ID":"b06eb2b9-81ca-47db-b4b1-a932d1812bd7","Type":"ContainerStarted","Data":"e734364bdbab500b56c074950e0f8e4c754ddea7d2cdde263743cb077b171fc7"}
Jul 07 18:50:41.743606 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.743548    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:41.825183 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.825160    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8w5xp_bbaf2cd6-c6bb-46bf-9540-c056445ce658/dns-node-resolver/0.log"
Jul 07 18:50:41.854184 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:41.854134    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:42.219804 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:42.219719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:42.219965 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:42.219889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:42.219965 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.219893    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:50:42.220084 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.220013    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:42.220084 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.220069    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm podName:5a8f543a-7988-4530-a7b6-fa1e4415546a nodeName:}" failed. No retries permitted until 2026-07-07 18:50:44.220018591 +0000 UTC m=+39.986125944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wqxgn" (UID: "5a8f543a-7988-4530-a7b6-fa1e4415546a") : configmap "kube-rbac-proxy" not found
Jul 07 18:50:42.220189 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.220096    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls podName:5a8f543a-7988-4530-a7b6-fa1e4415546a nodeName:}" failed. No retries permitted until 2026-07-07 18:50:44.22007799 +0000 UTC m=+39.986185356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxgn" (UID: "5a8f543a-7988-4530-a7b6-fa1e4415546a") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:42.320432 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:42.320382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:42.320576 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:42.320483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:42.320576 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.320560    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:50:42.320690 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.320628    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:50:42.320690 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.320640    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5cc8dccf-6phqn: secret "image-registry-tls" not found
Jul 07 18:50:42.320690 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.320632    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls podName:c7ceefaf-6695-46d9-b707-e4f0cd270c98 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:46.32061578 +0000 UTC m=+42.086723134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls") pod "dns-default-n8jnp" (UID: "c7ceefaf-6695-46d9-b707-e4f0cd270c98") : secret "dns-default-metrics-tls" not found
Jul 07 18:50:42.320854 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:42.320695    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls podName:5e3a5c49-400c-4550-888b-87f763daca59 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:46.320678662 +0000 UTC m=+42.086786020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls") pod "image-registry-7b5cc8dccf-6phqn" (UID: "5e3a5c49-400c-4550-888b-87f763daca59") : secret "image-registry-tls" not found
Jul 07 18:50:42.824694 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:42.824661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qj68x_461b6e43-3eb4-437e-99a6-9675ea6c3e16/node-ca/0.log"
Jul 07 18:50:42.839684 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:42.839639    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:42.909614 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:42.909578    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:43.349457 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.349424    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n845t"]
Jul 07 18:50:43.367812 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.367786    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n845t"]
Jul 07 18:50:43.367971 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.367891    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.370709 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.370684    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 18:50:43.372179 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.372000    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 18:50:43.372179 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.372094    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 18:50:43.372179 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.372095    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rmw4z\""
Jul 07 18:50:43.372369 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.372196    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 18:50:43.387229 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.387201    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:43.457760 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.457730    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:43.531524 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.531499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-signing-cabundle\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.531656 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.531553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-signing-key\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.531656 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.531580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntmp\" (UniqueName: \"kubernetes.io/projected/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-kube-api-access-bntmp\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.632409 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.632358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-signing-cabundle\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.632409 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.632392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-signing-key\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.632581 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.632428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntmp\" (UniqueName: \"kubernetes.io/projected/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-kube-api-access-bntmp\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.632969 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.632949    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-signing-cabundle\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.635578 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.635557    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-signing-key\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.642540 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.642519    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntmp\" (UniqueName: \"kubernetes.io/projected/181efc4e-adb0-4d7a-a9b0-9493cc8e279f-kube-api-access-bntmp\") pod \"service-ca-758f599c5-n845t\" (UID: \"181efc4e-adb0-4d7a-a9b0-9493cc8e279f\") " pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.678485 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.678465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n845t"
Jul 07 18:50:43.909501 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.909392    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:43.975821 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:43.975786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:44.166313 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.166235    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:44.219127 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.219105    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n845t"]
Jul 07 18:50:44.222021 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:44.221994    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181efc4e_adb0_4d7a_a9b0_9493cc8e279f.slice/crio-cec08148494d47fe0600ac553fc7e8f80d577bd72a18995ffaa1e4482e50b3ee WatchSource:0}: Error finding container cec08148494d47fe0600ac553fc7e8f80d577bd72a18995ffaa1e4482e50b3ee: Status 404 returned error can't find the container with id cec08148494d47fe0600ac553fc7e8f80d577bd72a18995ffaa1e4482e50b3ee
Jul 07 18:50:44.238479 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.238121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:44.238479 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.238166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:44.238479 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:44.238373    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:44.238479 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:44.238456    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls podName:5a8f543a-7988-4530-a7b6-fa1e4415546a nodeName:}" failed. No retries permitted until 2026-07-07 18:50:48.238435823 +0000 UTC m=+44.004543176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxgn" (UID: "5a8f543a-7988-4530-a7b6-fa1e4415546a") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:44.238804 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.238767    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a8f543a-7988-4530-a7b6-fa1e4415546a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:44.262992 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.262962    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:44.363702 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.363672    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qbhpz" event={"ID":"0eddf42a-b931-44a5-8b14-c18b6ef4fd59","Type":"ContainerStarted","Data":"abfe63a422b550c383dbb079789584875a35eaf1f314d8f93a7479e19b8c8ede"}
Jul 07 18:50:44.365459 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.365361    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n845t" event={"ID":"181efc4e-adb0-4d7a-a9b0-9493cc8e279f","Type":"ContainerStarted","Data":"cec08148494d47fe0600ac553fc7e8f80d577bd72a18995ffaa1e4482e50b3ee"}
Jul 07 18:50:44.368629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.368608    2577 generic.go:356] "Generic (PLEG): container finished" podID="bab075a0-179b-4731-b520-a770bd0d876c" containerID="4dacf0ec33d6bfa6ef339febbbc6dfc45eecc362a4e76e91485104176244e395" exitCode=0
Jul 07 18:50:44.368725 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.368681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" event={"ID":"bab075a0-179b-4731-b520-a770bd0d876c","Type":"ContainerDied","Data":"4dacf0ec33d6bfa6ef339febbbc6dfc45eecc362a4e76e91485104176244e395"}
Jul 07 18:50:44.370692 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.370667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh" event={"ID":"b06eb2b9-81ca-47db-b4b1-a932d1812bd7","Type":"ContainerStarted","Data":"d1c52c9130424eb18a45e2858322f4fc9fe688760d1b1c6a44c4947c5ad03c2d"}
Jul 07 18:50:44.370763 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.370716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh" event={"ID":"b06eb2b9-81ca-47db-b4b1-a932d1812bd7","Type":"ContainerStarted","Data":"fba0e5c5d6e68516d3f0299bb0aa60031e13d905d4f187994b1d26f60823ed61"}
Jul 07 18:50:44.383050 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.383013    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qbhpz" podStartSLOduration=1.439413453 podStartE2EDuration="6.383001063s" totalImagesPullingTime="4.94358761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:44.382145012 +0000 UTC m=+40.148252382" watchObservedRunningTime="2026-07-07 18:50:44.383001063 +0000 UTC m=+40.149108436"
Jul 07 18:50:44.399757 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.399719    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gb2zh" podStartSLOduration=1.256747965 podStartE2EDuration="4.399706577s" totalImagesPullingTime="3.142958612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:44.39825714 +0000 UTC m=+40.164364514" watchObservedRunningTime="2026-07-07 18:50:44.399706577 +0000 UTC m=+40.165813975"
Jul 07 18:50:44.550386 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:44.550362    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:45.375856 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:45.375826    2577 generic.go:356] "Generic (PLEG): container finished" podID="bab075a0-179b-4731-b520-a770bd0d876c" containerID="c47526063feeabe2a5205ceb3bc722b5d9ae78efac322e8d5ed80ae8ccf479ad" exitCode=0
Jul 07 18:50:45.376215 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:45.375916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" event={"ID":"bab075a0-179b-4731-b520-a770bd0d876c","Type":"ContainerDied","Data":"c47526063feeabe2a5205ceb3bc722b5d9ae78efac322e8d5ed80ae8ccf479ad"}
Jul 07 18:50:46.354178 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:46.354146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:46.354324 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:46.354197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:46.354324 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:46.354292    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:50:46.354324 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:46.354299    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:50:46.354457 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:46.354305    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5cc8dccf-6phqn: secret "image-registry-tls" not found
Jul 07 18:50:46.354457 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:46.354361    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls podName:c7ceefaf-6695-46d9-b707-e4f0cd270c98 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:54.354345678 +0000 UTC m=+50.120453029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls") pod "dns-default-n8jnp" (UID: "c7ceefaf-6695-46d9-b707-e4f0cd270c98") : secret "dns-default-metrics-tls" not found
Jul 07 18:50:46.354457 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:46.354450    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls podName:5e3a5c49-400c-4550-888b-87f763daca59 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:54.354432857 +0000 UTC m=+50.120540224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls") pod "image-registry-7b5cc8dccf-6phqn" (UID: "5e3a5c49-400c-4550-888b-87f763daca59") : secret "image-registry-tls" not found
Jul 07 18:50:46.381135 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:46.381112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" event={"ID":"bab075a0-179b-4731-b520-a770bd0d876c","Type":"ContainerStarted","Data":"ed627a46598ca2166c87448b0b1187cc596add305a9d6fde358ce01ce96dd5a1"}
Jul 07 18:50:46.410489 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:46.410449    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4ngsq" podStartSLOduration=7.339317053 podStartE2EDuration="41.410435706s" totalImagesPullingTime="34.071118653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:46.408804544 +0000 UTC m=+42.174911917" watchObservedRunningTime="2026-07-07 18:50:46.410435706 +0000 UTC m=+42.176543076"
Jul 07 18:50:47.044345 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:47.044307    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:47.098224 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:47.098198    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:47.384979 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:47.384909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n845t" event={"ID":"181efc4e-adb0-4d7a-a9b0-9493cc8e279f","Type":"ContainerStarted","Data":"05e86a87863ffa71ef96885763bfd76cc6954c4ba6f9b97418a43ab7e5a3f01b"}
Jul 07 18:50:47.401706 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:47.401669    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-n845t" podStartSLOduration=2.095968555 podStartE2EDuration="4.401656051s" totalImagesPullingTime="2.305687496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:47.401468766 +0000 UTC m=+43.167576139" watchObservedRunningTime="2026-07-07 18:50:47.401656051 +0000 UTC m=+43.167763467"
Jul 07 18:50:47.783663 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:47.783620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:47.937532 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:47.937498    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:48.073449 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:48.073310    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:48.170543 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:48.170504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:48.267975 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:48.267937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:48.268150 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:48.268097    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:48.268211 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:50:48.268178    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls podName:5a8f543a-7988-4530-a7b6-fa1e4415546a nodeName:}" failed. No retries permitted until 2026-07-07 18:50:56.268156911 +0000 UTC m=+52.034264265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wqxgn" (UID: "5a8f543a-7988-4530-a7b6-fa1e4415546a") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:50:48.268659 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:48.268636    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:48.369219 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:48.369133    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:48.487842 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:48.487812    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:48.584351 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:48.584326    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:49.689811 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:49.689781    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:49.876347 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:49.876305    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:50.075762 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:50.075726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:50.323702 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:50.323669    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:50.473594 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:50.473514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:51.177158 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:51.177126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:51.482862 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:51.482775    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:51.917585 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:51.917550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:52.079010 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:52.078953    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:52.179458 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:52.179364    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:52.284471 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:52.284431    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:52.690347 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:52.690313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:53.280458 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:53.280395    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:53.381112 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:53.381078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:53.439560 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:53.439531    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:53.496067 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:53.496035    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:53.880393 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:53.880363    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:53.980974 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:53.980940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:54.418556 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.418524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:54.419037 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.418576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:54.421302 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.421270    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7ceefaf-6695-46d9-b707-e4f0cd270c98-metrics-tls\") pod \"dns-default-n8jnp\" (UID: \"c7ceefaf-6695-46d9-b707-e4f0cd270c98\") " pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:54.421406 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.421270    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"image-registry-7b5cc8dccf-6phqn\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") " pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:54.510156 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.510121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:54.535149 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.535122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:54.642656 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.642615    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b5cc8dccf-6phqn"]
Jul 07 18:50:54.645647 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:54.645619    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3a5c49_400c_4550_888b_87f763daca59.slice/crio-d7c83388bda9dc8a3b575f8bc9e2617deb293257ac7946ba7ad547a909e34ea0 WatchSource:0}: Error finding container d7c83388bda9dc8a3b575f8bc9e2617deb293257ac7946ba7ad547a909e34ea0: Status 404 returned error can't find the container with id d7c83388bda9dc8a3b575f8bc9e2617deb293257ac7946ba7ad547a909e34ea0
Jul 07 18:50:54.664935 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.664911    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n8jnp"]
Jul 07 18:50:54.672346 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:54.672322    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ceefaf_6695_46d9_b707_e4f0cd270c98.slice/crio-2348de3254f66f6c09e95c6c461ae71c81aa86a196e7d9fdb644f97b91a36568 WatchSource:0}: Error finding container 2348de3254f66f6c09e95c6c461ae71c81aa86a196e7d9fdb644f97b91a36568: Status 404 returned error can't find the container with id 2348de3254f66f6c09e95c6c461ae71c81aa86a196e7d9fdb644f97b91a36568
Jul 07 18:50:54.676017 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.675961    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:54.878743 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:54.878708    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:55.277493 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:55.277461    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:55.407684 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:55.407647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8jnp" event={"ID":"c7ceefaf-6695-46d9-b707-e4f0cd270c98","Type":"ContainerStarted","Data":"2348de3254f66f6c09e95c6c461ae71c81aa86a196e7d9fdb644f97b91a36568"}
Jul 07 18:50:55.409021 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:55.408986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn" event={"ID":"5e3a5c49-400c-4550-888b-87f763daca59","Type":"ContainerStarted","Data":"ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49"}
Jul 07 18:50:55.409143 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:55.409040    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn" event={"ID":"5e3a5c49-400c-4550-888b-87f763daca59","Type":"ContainerStarted","Data":"d7c83388bda9dc8a3b575f8bc9e2617deb293257ac7946ba7ad547a909e34ea0"}
Jul 07 18:50:55.409200 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:55.409136    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:50:55.477843 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:55.477801    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:56.083813 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.083738    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:56.335117 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.335039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:56.337213 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.337182    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a8f543a-7988-4530-a7b6-fa1e4415546a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqxgn\" (UID: \"5a8f543a-7988-4530-a7b6-fa1e4415546a\") " pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:56.341578 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.341523    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:56.367370 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.367348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wqxgn"
Jul 07 18:50:56.480771 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.480736    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:56.504367 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.504231    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn" podStartSLOduration=34.504210497 podStartE2EDuration="34.504210497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:55.431507371 +0000 UTC m=+51.197614744" watchObservedRunningTime="2026-07-07 18:50:56.504210497 +0000 UTC m=+52.270317873"
Jul 07 18:50:56.505531 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.505511    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wqxgn"]
Jul 07 18:50:56.881158 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:56.881112    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:56.967715 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:50:56.967684    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8f543a_7988_4530_a7b6_fa1e4415546a.slice/crio-ad667aa88047828e928668827765f94edba2bfca7e1d63b01d3522c54e700dcb WatchSource:0}: Error finding container ad667aa88047828e928668827765f94edba2bfca7e1d63b01d3522c54e700dcb: Status 404 returned error can't find the container with id ad667aa88047828e928668827765f94edba2bfca7e1d63b01d3522c54e700dcb
Jul 07 18:50:57.078590 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:57.078560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:57.420189 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:57.420107    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqxgn" event={"ID":"5a8f543a-7988-4530-a7b6-fa1e4415546a","Type":"ContainerStarted","Data":"ad667aa88047828e928668827765f94edba2bfca7e1d63b01d3522c54e700dcb"}
Jul 07 18:50:57.423603 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:57.423573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8jnp" event={"ID":"c7ceefaf-6695-46d9-b707-e4f0cd270c98","Type":"ContainerStarted","Data":"eef3cbc052042aac17939db70f0dd7d2f24934550ace0579a1d3ab7060b40223"}
Jul 07 18:50:57.423743 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:57.423629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8jnp" event={"ID":"c7ceefaf-6695-46d9-b707-e4f0cd270c98","Type":"ContainerStarted","Data":"4e16dc07ccc0f37dae3414019cbf1ac0d6279fbda08edc09f2f240a2015da715"}
Jul 07 18:50:57.424354 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:57.424328    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:50:57.444906 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:57.444653    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n8jnp" podStartSLOduration=17.121875857 podStartE2EDuration="19.444631881s" totalImagesPullingTime="2.322756024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:57.443649855 +0000 UTC m=+53.209757230" watchObservedRunningTime="2026-07-07 18:50:57.444631881 +0000 UTC m=+53.210739257"
Jul 07 18:50:57.483583 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:57.483528    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:58.077267 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:58.077236    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:58.284089 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:58.284046    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:58.483709 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:50:58.483607    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:01.439992 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:01.439916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqxgn" event={"ID":"5a8f543a-7988-4530-a7b6-fa1e4415546a","Type":"ContainerStarted","Data":"57cd4a4a40e7c68260125feed21bd916189599050562122d069b4f112d095e5d"}
Jul 07 18:51:01.439992 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:01.439968    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqxgn" event={"ID":"5a8f543a-7988-4530-a7b6-fa1e4415546a","Type":"ContainerStarted","Data":"5ab405122c39556c3755c30221642007b4db808558293e4b30f9024d3947010a"}
Jul 07 18:51:02.045748 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:02.045695    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:02.146486 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:02.146439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:02.961334 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:02.961293    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:03.060779 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:03.060749    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:03.418904 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:03.418866    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:03.602013 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:03.601963    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:03.676185 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:03.676045    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:03.791518 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:03.791486    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:04.451995 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:04.451960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqxgn" event={"ID":"5a8f543a-7988-4530-a7b6-fa1e4415546a","Type":"ContainerStarted","Data":"13698f75445df883fdc75c87d3cd0ce92138cc07a0f2a1ed0c9867dcec6cc039"}
Jul 07 18:51:04.472948 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:04.472902    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wqxgn" podStartSLOduration=17.727355781 podStartE2EDuration="24.472888309s" totalImagesPullingTime="6.745532528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:04.470830601 +0000 UTC m=+60.236937975" watchObservedRunningTime="2026-07-07 18:51:04.472888309 +0000 UTC m=+60.238995693"
Jul 07 18:51:04.809012 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:04.808979    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:05.005269 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:05.005240    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:05.309372 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:05.309336    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:05.341143 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:05.341120    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6qpg"
Jul 07 18:51:05.646433 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:05.646341    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:05.753914 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:05.753875    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:07.499103 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.499068    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:07.516808 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.516785    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"]
Jul 07 18:51:07.519801 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.519782    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"]
Jul 07 18:51:07.519921 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.519902    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"
Jul 07 18:51:07.521789 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.521772    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"]
Jul 07 18:51:07.521904 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.521883    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.524124 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.524109    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"]
Jul 07 18:51:07.524243 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.524228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.525933 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.525919    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"
Jul 07 18:51:07.528283 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.528263    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 18:51:07.528672 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.528609    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 18:51:07.528672 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.528616    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 18:51:07.528832 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.528760    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 18:51:07.529965 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.529949    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 18:51:07.530023 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.529949    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 18:51:07.530266 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.530246    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 18:51:07.530266 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.530261    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 18:51:07.530454 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.530249    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 18:51:07.530454 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.530249    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 18:51:07.530454 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.530324    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-s264z\""
Jul 07 18:51:07.530454 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.530440    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 18:51:07.530454 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.530441    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bp8jw\""
Jul 07 18:51:07.534636 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.534620    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"]
Jul 07 18:51:07.535858 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.535837    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"]
Jul 07 18:51:07.544907 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.544854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"]
Jul 07 18:51:07.546217 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.546198    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"]
Jul 07 18:51:07.600445 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.600423    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b5cc8dccf-6phqn"]
Jul 07 18:51:07.616287 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-hub\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.616397 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.616397 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7mv2\" (UniqueName: \"kubernetes.io/projected/171695c8-bce1-429a-bc2c-53805841105e-kube-api-access-b7mv2\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.616495 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37fd92d4-1cd4-4577-a8f4-6a60e66e17d7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f9jjh\" (UID: \"37fd92d4-1cd4-4577-a8f4-6a60e66e17d7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"
Jul 07 18:51:07.616495 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/171695c8-bce1-429a-bc2c-53805841105e-tmp\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.616495 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37fd92d4-1cd4-4577-a8f4-6a60e66e17d7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f9jjh\" (UID: \"37fd92d4-1cd4-4577-a8f4-6a60e66e17d7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"
Jul 07 18:51:07.616616 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d4207bc-0086-47e8-ac57-448fda5ab227-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dd8fdf8-h8p85\" (UID: \"1d4207bc-0086-47e8-ac57-448fda5ab227\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"
Jul 07 18:51:07.616616 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgb4x\" (UniqueName: \"kubernetes.io/projected/1d4207bc-0086-47e8-ac57-448fda5ab227-kube-api-access-mgb4x\") pod \"managed-serviceaccount-addon-agent-86dd8fdf8-h8p85\" (UID: \"1d4207bc-0086-47e8-ac57-448fda5ab227\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"
Jul 07 18:51:07.616718 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlsqs\" (UniqueName: \"kubernetes.io/projected/a5f322ee-354a-4861-b55a-1d6d77f06202-kube-api-access-xlsqs\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.616718 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.616718 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/171695c8-bce1-429a-bc2c-53805841105e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.616859 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5f322ee-354a-4861-b55a-1d6d77f06202-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.616859 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.616810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-ca\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.666864 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.666824    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:07.717119 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlsqs\" (UniqueName: \"kubernetes.io/projected/a5f322ee-354a-4861-b55a-1d6d77f06202-kube-api-access-xlsqs\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.717261 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.717261 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/171695c8-bce1-429a-bc2c-53805841105e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.717261 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5f322ee-354a-4861-b55a-1d6d77f06202-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.717261 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-ca\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.717482 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-hub\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.717482 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.717482 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7mv2\" (UniqueName: \"kubernetes.io/projected/171695c8-bce1-429a-bc2c-53805841105e-kube-api-access-b7mv2\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.717623 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37fd92d4-1cd4-4577-a8f4-6a60e66e17d7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f9jjh\" (UID: \"37fd92d4-1cd4-4577-a8f4-6a60e66e17d7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"
Jul 07 18:51:07.717623 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/171695c8-bce1-429a-bc2c-53805841105e-tmp\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.717623 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37fd92d4-1cd4-4577-a8f4-6a60e66e17d7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f9jjh\" (UID: \"37fd92d4-1cd4-4577-a8f4-6a60e66e17d7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"
Jul 07 18:51:07.717623 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d4207bc-0086-47e8-ac57-448fda5ab227-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dd8fdf8-h8p85\" (UID: \"1d4207bc-0086-47e8-ac57-448fda5ab227\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"
Jul 07 18:51:07.717623 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.717616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgb4x\" (UniqueName: \"kubernetes.io/projected/1d4207bc-0086-47e8-ac57-448fda5ab227-kube-api-access-mgb4x\") pod \"managed-serviceaccount-addon-agent-86dd8fdf8-h8p85\" (UID: \"1d4207bc-0086-47e8-ac57-448fda5ab227\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"
Jul 07 18:51:07.718084 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.718062    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/171695c8-bce1-429a-bc2c-53805841105e-tmp\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.718843 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.718789    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37fd92d4-1cd4-4577-a8f4-6a60e66e17d7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f9jjh\" (UID: \"37fd92d4-1cd4-4577-a8f4-6a60e66e17d7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"
Jul 07 18:51:07.719070 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.719045    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5f322ee-354a-4861-b55a-1d6d77f06202-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.720402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.720297    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.720402 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.720358    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-ca\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.720557 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.720435    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-hub\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.720744 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.720725    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37fd92d4-1cd4-4577-a8f4-6a60e66e17d7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f9jjh\" (UID: \"37fd92d4-1cd4-4577-a8f4-6a60e66e17d7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"
Jul 07 18:51:07.720873 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.720850    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a5f322ee-354a-4861-b55a-1d6d77f06202-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.721025 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.721006    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d4207bc-0086-47e8-ac57-448fda5ab227-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dd8fdf8-h8p85\" (UID: \"1d4207bc-0086-47e8-ac57-448fda5ab227\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"
Jul 07 18:51:07.721085 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.721057    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/171695c8-bce1-429a-bc2c-53805841105e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.733312 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.733293    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlsqs\" (UniqueName: \"kubernetes.io/projected/a5f322ee-354a-4861-b55a-1d6d77f06202-kube-api-access-xlsqs\") pod \"cluster-proxy-proxy-agent-66856c8c6b-dqq6j\" (UID: \"a5f322ee-354a-4861-b55a-1d6d77f06202\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.739976 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.739949    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgb4x\" (UniqueName: \"kubernetes.io/projected/1d4207bc-0086-47e8-ac57-448fda5ab227-kube-api-access-mgb4x\") pod \"managed-serviceaccount-addon-agent-86dd8fdf8-h8p85\" (UID: \"1d4207bc-0086-47e8-ac57-448fda5ab227\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"
Jul 07 18:51:07.740351 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.740332    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7mv2\" (UniqueName: \"kubernetes.io/projected/171695c8-bce1-429a-bc2c-53805841105e-kube-api-access-b7mv2\") pod \"klusterlet-addon-workmgr-7966f549fd-fdfk8\" (UID: \"171695c8-bce1-429a-bc2c-53805841105e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.740477 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.740399    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d97967857-9c2pc"]
Jul 07 18:51:07.743465 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.743447    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.762706 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.762647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d97967857-9c2pc"]
Jul 07 18:51:07.818855 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.818827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4da0eb64-be53-4c60-8ddf-001484c1ec31-ca-trust-extracted\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.818965 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.818865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-registry-tls\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.818965 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.818884    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q995n\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-kube-api-access-q995n\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.819048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.818965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4da0eb64-be53-4c60-8ddf-001484c1ec31-installation-pull-secrets\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.819048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.819009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4da0eb64-be53-4c60-8ddf-001484c1ec31-image-registry-private-configuration\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.819048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.819027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-bound-sa-token\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.819048 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.819045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4da0eb64-be53-4c60-8ddf-001484c1ec31-registry-certificates\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.819187 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.819067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4da0eb64-be53-4c60-8ddf-001484c1ec31-trusted-ca\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.829367 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.829336    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:07.830063 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.830051    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"
Jul 07 18:51:07.837908 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.837889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:07.852360 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.852322    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"
Jul 07 18:51:07.858404 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.858383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.919586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-registry-tls\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.919645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q995n\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-kube-api-access-q995n\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.919690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4da0eb64-be53-4c60-8ddf-001484c1ec31-installation-pull-secrets\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.919746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4da0eb64-be53-4c60-8ddf-001484c1ec31-image-registry-private-configuration\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.919773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-bound-sa-token\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.919804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4da0eb64-be53-4c60-8ddf-001484c1ec31-registry-certificates\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.919830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4da0eb64-be53-4c60-8ddf-001484c1ec31-trusted-ca\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.919897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4da0eb64-be53-4c60-8ddf-001484c1ec31-ca-trust-extracted\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.924857 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.920324    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4da0eb64-be53-4c60-8ddf-001484c1ec31-ca-trust-extracted\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.931664 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.926391    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4da0eb64-be53-4c60-8ddf-001484c1ec31-trusted-ca\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.931664 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.930938    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4da0eb64-be53-4c60-8ddf-001484c1ec31-registry-certificates\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.931917 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.931856    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4da0eb64-be53-4c60-8ddf-001484c1ec31-image-registry-private-configuration\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.932762 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.932494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:07.936986 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.936831    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4da0eb64-be53-4c60-8ddf-001484c1ec31-installation-pull-secrets\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.937503 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.937482    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q995n\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-kube-api-access-q995n\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.938515 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.938462    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-registry-tls\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:07.949697 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:07.949518    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4da0eb64-be53-4c60-8ddf-001484c1ec31-bound-sa-token\") pod \"image-registry-5d97967857-9c2pc\" (UID: \"4da0eb64-be53-4c60-8ddf-001484c1ec31\") " pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:08.007394 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.007363    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh"]
Jul 07 18:51:08.010967 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:51:08.010933    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37fd92d4_1cd4_4577_a8f4_6a60e66e17d7.slice/crio-f63133780ab9c1e6d4cc89b06f9fc8cfb4b5fc782b584aecd0e9b4731b5e7e20 WatchSource:0}: Error finding container f63133780ab9c1e6d4cc89b06f9fc8cfb4b5fc782b584aecd0e9b4731b5e7e20: Status 404 returned error can't find the container with id f63133780ab9c1e6d4cc89b06f9fc8cfb4b5fc782b584aecd0e9b4731b5e7e20
Jul 07 18:51:08.013064 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.013020    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:08.020454 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.020366    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"]
Jul 07 18:51:08.024160 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:51:08.024136    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171695c8_bce1_429a_bc2c_53805841105e.slice/crio-693f765d661ed92d073abf7c4690484e858913468d355a13a0f73c80b6ed1ef2 WatchSource:0}: Error finding container 693f765d661ed92d073abf7c4690484e858913468d355a13a0f73c80b6ed1ef2: Status 404 returned error can't find the container with id 693f765d661ed92d073abf7c4690484e858913468d355a13a0f73c80b6ed1ef2
Jul 07 18:51:08.041506 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.041478    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j"]
Jul 07 18:51:08.043611 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:51:08.043590    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5f322ee_354a_4861_b55a_1d6d77f06202.slice/crio-005dec1ca2faf1e79e732cb0625e96cdde20f3297888053347c02ef82fa8ee37 WatchSource:0}: Error finding container 005dec1ca2faf1e79e732cb0625e96cdde20f3297888053347c02ef82fa8ee37: Status 404 returned error can't find the container with id 005dec1ca2faf1e79e732cb0625e96cdde20f3297888053347c02ef82fa8ee37
Jul 07 18:51:08.055927 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.055905    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85"]
Jul 07 18:51:08.057870 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:51:08.057848    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4207bc_0086_47e8_ac57_448fda5ab227.slice/crio-dea56ac00e87b02d70e19bec768e31db7fbada20a94a561872eabbab651e9f5f WatchSource:0}: Error finding container dea56ac00e87b02d70e19bec768e31db7fbada20a94a561872eabbab651e9f5f: Status 404 returned error can't find the container with id dea56ac00e87b02d70e19bec768e31db7fbada20a94a561872eabbab651e9f5f
Jul 07 18:51:08.071273 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.071252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:08.194150 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.194038    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d97967857-9c2pc"]
Jul 07 18:51:08.196462 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:51:08.196441    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da0eb64_be53_4c60_8ddf_001484c1ec31.slice/crio-75c17583b7239ef2c23701cc8a4ad170d4e3285a6b03924c402e4b11285e85fb WatchSource:0}: Error finding container 75c17583b7239ef2c23701cc8a4ad170d4e3285a6b03924c402e4b11285e85fb: Status 404 returned error can't find the container with id 75c17583b7239ef2c23701cc8a4ad170d4e3285a6b03924c402e4b11285e85fb
Jul 07 18:51:08.405190 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.405060    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:08.434760 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.434732    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n8jnp"
Jul 07 18:51:08.473349 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.473203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d97967857-9c2pc" event={"ID":"4da0eb64-be53-4c60-8ddf-001484c1ec31","Type":"ContainerStarted","Data":"ddeec224aa8ab5c2824b9b043e46aa6918463109c6e1ff97f09cfc143719a41c"}
Jul 07 18:51:08.473349 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.473263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d97967857-9c2pc" event={"ID":"4da0eb64-be53-4c60-8ddf-001484c1ec31","Type":"ContainerStarted","Data":"75c17583b7239ef2c23701cc8a4ad170d4e3285a6b03924c402e4b11285e85fb"}
Jul 07 18:51:08.474036 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.473986    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:08.475887 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.475856    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j" event={"ID":"a5f322ee-354a-4861-b55a-1d6d77f06202","Type":"ContainerStarted","Data":"005dec1ca2faf1e79e732cb0625e96cdde20f3297888053347c02ef82fa8ee37"}
Jul 07 18:51:08.478121 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.478092    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8" event={"ID":"171695c8-bce1-429a-bc2c-53805841105e","Type":"ContainerStarted","Data":"693f765d661ed92d073abf7c4690484e858913468d355a13a0f73c80b6ed1ef2"}
Jul 07 18:51:08.482243 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.482123    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85" event={"ID":"1d4207bc-0086-47e8-ac57-448fda5ab227","Type":"ContainerStarted","Data":"dea56ac00e87b02d70e19bec768e31db7fbada20a94a561872eabbab651e9f5f"}
Jul 07 18:51:08.484155 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.484132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh" event={"ID":"37fd92d4-1cd4-4577-a8f4-6a60e66e17d7","Type":"ContainerStarted","Data":"f63133780ab9c1e6d4cc89b06f9fc8cfb4b5fc782b584aecd0e9b4731b5e7e20"}
Jul 07 18:51:08.499476 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:08.498523    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d97967857-9c2pc" podStartSLOduration=1.498488489 podStartE2EDuration="1.498488489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:08.497579381 +0000 UTC m=+64.263686754" watchObservedRunningTime="2026-07-07 18:51:08.498488489 +0000 UTC m=+64.264595841"
Jul 07 18:51:09.536522 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.536488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:51:09.537097 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.536694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:51:09.541390 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.541197    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:51:09.542560 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.542358    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:51:09.557044 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.556995    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7230ed43-8af3-4249-8e93-7045e0921ce2-metrics-certs\") pod \"network-metrics-daemon-ftpks\" (UID: \"7230ed43-8af3-4249-8e93-7045e0921ce2\") " pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:51:09.564252 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.564209    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d65a8f1-ab8f-46d0-a54b-aebd01376b95-original-pull-secret\") pod \"global-pull-secret-syncer-hrwfd\" (UID: \"5d65a8f1-ab8f-46d0-a54b-aebd01376b95\") " pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:51:09.615318 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.615037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrwfd"
Jul 07 18:51:09.622178 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.622152    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l98hl\""
Jul 07 18:51:09.630573 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.630352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftpks"
Jul 07 18:51:09.637843 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.637373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:51:09.640796 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.640594    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:51:09.650860 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.650677    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:51:09.665182 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.665156    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxjm2\" (UniqueName: \"kubernetes.io/projected/fabc8876-768c-4139-86a3-eaef84dba62c-kube-api-access-rxjm2\") pod \"network-check-target-59xj2\" (UID: \"fabc8876-768c-4139-86a3-eaef84dba62c\") " pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:51:09.912598 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.912303    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cxlw6\""
Jul 07 18:51:09.920024 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.919868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:51:09.998628 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:09.998493    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:10.063982 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:10.063867    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:11.422761 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:11.422730    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrwfd"]
Jul 07 18:51:11.456865 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:11.456842    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ftpks"]
Jul 07 18:51:11.844689 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:11.844653    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:11.917457 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:11.917405    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:12.469380 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:51:12.469350    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d65a8f1_ab8f_46d0_a54b_aebd01376b95.slice/crio-ace6511af893604b2f0e173a0e22797ab93c25f0e869276dcf6ecf442191c4c8 WatchSource:0}: Error finding container ace6511af893604b2f0e173a0e22797ab93c25f0e869276dcf6ecf442191c4c8: Status 404 returned error can't find the container with id ace6511af893604b2f0e173a0e22797ab93c25f0e869276dcf6ecf442191c4c8
Jul 07 18:51:12.502389 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:12.502253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:12.506033 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:12.505996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrwfd" event={"ID":"5d65a8f1-ab8f-46d0-a54b-aebd01376b95","Type":"ContainerStarted","Data":"ace6511af893604b2f0e173a0e22797ab93c25f0e869276dcf6ecf442191c4c8"}
Jul 07 18:51:12.507360 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:12.507333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ftpks" event={"ID":"7230ed43-8af3-4249-8e93-7045e0921ce2","Type":"ContainerStarted","Data":"70a74ec88e0057b014a4fe9a7512d1830cbe2339de3b42e70f26cd172c2b244b"}
Jul 07 18:51:12.615099 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:12.615065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-59xj2"]
Jul 07 18:51:13.139182 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:13.139142    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:13.213719 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:13.213685    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:13.641758 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:51:13.641726    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabc8876_768c_4139_86a3_eaef84dba62c.slice/crio-7d1c49e5e3640dc938b1733880c308b30c220437f3dbfe26148d232cebaee15e WatchSource:0}: Error finding container 7d1c49e5e3640dc938b1733880c308b30c220437f3dbfe26148d232cebaee15e: Status 404 returned error can't find the container with id 7d1c49e5e3640dc938b1733880c308b30c220437f3dbfe26148d232cebaee15e
Jul 07 18:51:14.518464 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.518360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-59xj2" event={"ID":"fabc8876-768c-4139-86a3-eaef84dba62c","Type":"ContainerStarted","Data":"7d1c49e5e3640dc938b1733880c308b30c220437f3dbfe26148d232cebaee15e"}
Jul 07 18:51:14.522356 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.521264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j" event={"ID":"a5f322ee-354a-4861-b55a-1d6d77f06202","Type":"ContainerStarted","Data":"e7b8e838392c9c660946313cd265a7cbddc60a64feed85d43f26ee16bacb15dd"}
Jul 07 18:51:14.522356 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.521313    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j" event={"ID":"a5f322ee-354a-4861-b55a-1d6d77f06202","Type":"ContainerStarted","Data":"e7b1c6d66b9651ae08d97b890b478e897c4e26a02eb6909a3c907a0923f8104e"}
Jul 07 18:51:14.522356 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.521332    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j" event={"ID":"a5f322ee-354a-4861-b55a-1d6d77f06202","Type":"ContainerStarted","Data":"7ff08c75925b9512d88e545acd5502feea8953a1666164a48e5118fdb433ec64"}
Jul 07 18:51:14.524548 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.524460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8" event={"ID":"171695c8-bce1-429a-bc2c-53805841105e","Type":"ContainerStarted","Data":"b185bfa94c267d524961c057a11889e8c6562f76835f485b234cc6d653600350"}
Jul 07 18:51:14.524548 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.524511    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:14.526372 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.526349    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8"
Jul 07 18:51:14.526567 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.526547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85" event={"ID":"1d4207bc-0086-47e8-ac57-448fda5ab227","Type":"ContainerStarted","Data":"14498154c01e11c5629fcee24ca76fa0a9cf83ac24dd321c6ec428559f838172"}
Jul 07 18:51:14.528762 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.528736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh" event={"ID":"37fd92d4-1cd4-4577-a8f4-6a60e66e17d7","Type":"ContainerStarted","Data":"52bbc6390c5627cd8accfaa1ec5a7a473325dd81ad36691cf20966dbd6fab6d9"}
Jul 07 18:51:14.540898 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.540819    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66856c8c6b-dqq6j" podStartSLOduration=1.902404709 podStartE2EDuration="7.540804276s" totalImagesPullingTime="5.638399567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:14.539436211 +0000 UTC m=+70.305543582" watchObservedRunningTime="2026-07-07 18:51:14.540804276 +0000 UTC m=+70.306911651"
Jul 07 18:51:14.556533 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.556381    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f9jjh" podStartSLOduration=1.9468795399999999 podStartE2EDuration="7.556362815s" totalImagesPullingTime="5.609483275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:14.5546266 +0000 UTC m=+70.320733974" watchObservedRunningTime="2026-07-07 18:51:14.556362815 +0000 UTC m=+70.322470189"
Jul 07 18:51:14.572100 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.572055    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7966f549fd-fdfk8" podStartSLOduration=1.913485423 podStartE2EDuration="7.572036813s" totalImagesPullingTime="5.65855139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:14.569921819 +0000 UTC m=+70.336029193" watchObservedRunningTime="2026-07-07 18:51:14.572036813 +0000 UTC m=+70.338144188"
Jul 07 18:51:14.586139 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.586093    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd8fdf8-h8p85" podStartSLOduration=1.986400188 podStartE2EDuration="7.586076792s" totalImagesPullingTime="5.599676604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:14.585971378 +0000 UTC m=+70.352078752" watchObservedRunningTime="2026-07-07 18:51:14.586076792 +0000 UTC m=+70.352184166"
Jul 07 18:51:14.685178 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.685148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:14.787264 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.787213    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:14.931272 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:14.931244    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:15.535058 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:15.535014    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ftpks" event={"ID":"7230ed43-8af3-4249-8e93-7045e0921ce2","Type":"ContainerStarted","Data":"5365ead2c318cbe1441ed98df9faaf1b59e81ccafa22fffb1a870ccd6c46fb44"}
Jul 07 18:51:15.535237 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:15.535085    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ftpks" event={"ID":"7230ed43-8af3-4249-8e93-7045e0921ce2","Type":"ContainerStarted","Data":"69cc37e36ebd05c9d130e9cc385128103fdacdb5a8bcfec375c6025268e8daa5"}
Jul 07 18:51:15.555710 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:15.555659    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ftpks" podStartSLOduration=68.466657592 podStartE2EDuration="1m10.555641787s" totalImagesPullingTime="2.088984195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:15.553385344 +0000 UTC m=+71.319492725" watchObservedRunningTime="2026-07-07 18:51:15.555641787 +0000 UTC m=+71.321749161"
Jul 07 18:51:15.678092 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:15.678057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:15.792989 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:15.792910    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:16.133273 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:16.133109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:16.191193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:16.191150    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:16.629950 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:16.629913    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:16.696723 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:16.696692    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:16.997491 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:16.997462    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.108232 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.108197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.214274 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.214238    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.269851 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.269725    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5zbw8"]
Jul 07 18:51:17.273704 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.273682    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.276698 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.276672    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gwjgx\""
Jul 07 18:51:17.276816 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.276679    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 18:51:17.277902 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.277882    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 18:51:17.278589 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.278116    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 18:51:17.278589 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.278250    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 18:51:17.278589 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.278474    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 18:51:17.278854 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.278677    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 18:51:17.292852 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.292830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-wtmp\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.292960 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.292867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-sys\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.292960 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.292895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-tls\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.292960 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.292918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/170db113-c3b3-475a-8cd5-2da922e17f7f-metrics-client-ca\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.292960 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.292950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bkwm\" (UniqueName: \"kubernetes.io/projected/170db113-c3b3-475a-8cd5-2da922e17f7f-kube-api-access-9bkwm\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.293193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.292983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-textfile\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.293193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.293006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.293193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.293093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-root\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.293193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.293149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.293193 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.293164    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.375654 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.375625    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.393574 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.393696 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-wtmp\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.393764 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-sys\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.393764 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393735    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-wtmp\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.393764 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-tls\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.393910 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/170db113-c3b3-475a-8cd5-2da922e17f7f-metrics-client-ca\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.393910 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bkwm\" (UniqueName: \"kubernetes.io/projected/170db113-c3b3-475a-8cd5-2da922e17f7f-kube-api-access-9bkwm\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.393910 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-textfile\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.393910 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:51:17.393885    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 18:51:17.393910 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.394134 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-root\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.394134 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:51:17.393959    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-tls podName:170db113-c3b3-475a-8cd5-2da922e17f7f nodeName:}" failed. No retries permitted until 2026-07-07 18:51:17.893938307 +0000 UTC m=+73.660045662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-tls") pod "node-exporter-5zbw8" (UID: "170db113-c3b3-475a-8cd5-2da922e17f7f") : secret "node-exporter-tls" not found
Jul 07 18:51:17.394134 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.394014    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-root\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.394308 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.393785    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/170db113-c3b3-475a-8cd5-2da922e17f7f-sys\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.394308 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.394259    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-textfile\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.394427 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.394390    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/170db113-c3b3-475a-8cd5-2da922e17f7f-metrics-client-ca\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.394670 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.394639    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.396151 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.396130    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.404702 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.404677    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bkwm\" (UniqueName: \"kubernetes.io/projected/170db113-c3b3-475a-8cd5-2da922e17f7f-kube-api-access-9bkwm\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.475436 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.475381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.575770 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.575698    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.608582 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.608560    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:51:17.647453 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.646849    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.839792 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.839713    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.902334 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.902273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-tls\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.905150 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.905127    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/170db113-c3b3-475a-8cd5-2da922e17f7f-node-exporter-tls\") pod \"node-exporter-5zbw8\" (UID: \"170db113-c3b3-475a-8cd5-2da922e17f7f\") " pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:17.944819 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:17.944740    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.045394 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:18.045358    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.150851 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:18.150743    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.186484 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:18.186459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5zbw8"
Jul 07 18:51:18.327486 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:18.327453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.463715 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:18.463637    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.607180 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:18.607148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.968486 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:51:18.968457    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170db113_c3b3_475a_8cd5_2da922e17f7f.slice/crio-8d993cc77be70e145eda8df70f2eff9c74e9bb3cbb53716f8de7330cea0062c9 WatchSource:0}: Error finding container 8d993cc77be70e145eda8df70f2eff9c74e9bb3cbb53716f8de7330cea0062c9: Status 404 returned error can't find the container with id 8d993cc77be70e145eda8df70f2eff9c74e9bb3cbb53716f8de7330cea0062c9
Jul 07 18:51:19.555438 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:19.555355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrwfd" event={"ID":"5d65a8f1-ab8f-46d0-a54b-aebd01376b95","Type":"ContainerStarted","Data":"efdae8b0b8ffc9867a352e65510fd0ac307f9f2b47fe50f41eba1d8389087ae2"}
Jul 07 18:51:19.557320 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:19.557288    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-59xj2" event={"ID":"fabc8876-768c-4139-86a3-eaef84dba62c","Type":"ContainerStarted","Data":"d9c3e9675407540ebb09295e89bfdb502f56c120e580df43f82096fb6543e066"}
Jul 07 18:51:19.557480 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:19.557353    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:51:19.558747 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:19.558719    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zbw8" event={"ID":"170db113-c3b3-475a-8cd5-2da922e17f7f","Type":"ContainerStarted","Data":"8d993cc77be70e145eda8df70f2eff9c74e9bb3cbb53716f8de7330cea0062c9"}
Jul 07 18:51:19.575442 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:19.575377    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hrwfd" podStartSLOduration=68.078908791 podStartE2EDuration="1m14.575359369s" totalImagesPullingTime="6.496450578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:19.57363916 +0000 UTC m=+75.339746534" watchObservedRunningTime="2026-07-07 18:51:19.575359369 +0000 UTC m=+75.341466726"
Jul 07 18:51:19.592936 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:19.592894    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-59xj2" podStartSLOduration=69.278626093 podStartE2EDuration="1m14.592878155s" totalImagesPullingTime="5.314252062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:19.59240208 +0000 UTC m=+75.358509453" watchObservedRunningTime="2026-07-07 18:51:19.592878155 +0000 UTC m=+75.358985529"
Jul 07 18:51:20.240188 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:20.240159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:20.338828 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:20.338785    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:20.461911 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:20.461881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:20.564222 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:20.564194    2577 generic.go:356] "Generic (PLEG): container finished" podID="170db113-c3b3-475a-8cd5-2da922e17f7f" containerID="eca4da715d42f7860a6d0512aa372e0eeb1645641d97fd8266d52cf53d84a95f" exitCode=0
Jul 07 18:51:20.564576 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:20.564278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zbw8" event={"ID":"170db113-c3b3-475a-8cd5-2da922e17f7f","Type":"ContainerDied","Data":"eca4da715d42f7860a6d0512aa372e0eeb1645641d97fd8266d52cf53d84a95f"}
Jul 07 18:51:20.646470 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:20.646443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:21.440456 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:21.440401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:21.543272 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:21.543233    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:21.570638 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:21.570609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zbw8" event={"ID":"170db113-c3b3-475a-8cd5-2da922e17f7f","Type":"ContainerStarted","Data":"027dcfb3a2b5b897147d5f9034f979ed29b1e1d55645452789ba9cde2b3a7792"}
Jul 07 18:51:21.570948 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:21.570681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zbw8" event={"ID":"170db113-c3b3-475a-8cd5-2da922e17f7f","Type":"ContainerStarted","Data":"91676233ad1833ceb5b3f83641ecf092b1daac2da1c4858e39691964df3c5a2f"}
Jul 07 18:51:21.600777 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:21.600731    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5zbw8" podStartSLOduration=3.289153454 podStartE2EDuration="4.600714626s" totalImagesPullingTime="1.246940902s" totalInitContainerRuntime="64.62027ms" isStatefulPod=true podCreationTimestamp="2026-07-07 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:21.598836737 +0000 UTC m=+77.364944122" watchObservedRunningTime="2026-07-07 18:51:21.600714626 +0000 UTC m=+77.366821999"
Jul 07 18:51:22.036157 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:22.036114    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:22.134343 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:22.134310    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:22.682177 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:22.682145    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:23.495307 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:23.495272    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:24.770288 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:24.770255    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:24.827014 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:24.826989    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:25.436967 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:25.436932    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:25.511753 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:25.511712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:26.615912 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:26.615800    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:26.716177 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:26.716138    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:26.840190 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:26.840159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:26.948290 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:26.948213    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:30.499337 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:30.499312    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d97967857-9c2pc"
Jul 07 18:51:30.516118 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:30.516082    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:30.616552 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:30.616515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:30.717321 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:30.717288    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:30.770351 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:30.770284    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:30.939004 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:30.938971    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:31.029262 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:31.029186    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:31.100643 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:31.100597    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:32.042678 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:32.042643    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:32.106110 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:32.106081    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:32.619329 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:32.619294    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn" podUID="5e3a5c49-400c-4550-888b-87f763daca59" containerName="registry" containerID="cri-o://ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49" gracePeriod=30
Jul 07 18:51:33.055572 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.055541    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:33.153469 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.153443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:33.229258 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.229228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:33.386588 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.386567    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:51:33.411355 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411333    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-registry-certificates\") pod \"5e3a5c49-400c-4550-888b-87f763daca59\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") "
Jul 07 18:51:33.411538 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-bound-sa-token\") pod \"5e3a5c49-400c-4550-888b-87f763daca59\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") "
Jul 07 18:51:33.411538 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411381    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-trusted-ca\") pod \"5e3a5c49-400c-4550-888b-87f763daca59\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") "
Jul 07 18:51:33.411538 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411499    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-installation-pull-secrets\") pod \"5e3a5c49-400c-4550-888b-87f763daca59\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") "
Jul 07 18:51:33.411538 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411538    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-image-registry-private-configuration\") pod \"5e3a5c49-400c-4550-888b-87f763daca59\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") "
Jul 07 18:51:33.413731 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411759    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5e3a5c49-400c-4550-888b-87f763daca59" (UID: "5e3a5c49-400c-4550-888b-87f763daca59"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:51:33.413731 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411789    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5e3a5c49-400c-4550-888b-87f763daca59" (UID: "5e3a5c49-400c-4550-888b-87f763daca59"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:51:33.413731 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411853    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") pod \"5e3a5c49-400c-4550-888b-87f763daca59\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") "
Jul 07 18:51:33.413731 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411941    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e3a5c49-400c-4550-888b-87f763daca59-ca-trust-extracted\") pod \"5e3a5c49-400c-4550-888b-87f763daca59\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") "
Jul 07 18:51:33.413731 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.411974    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmrnj\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-kube-api-access-rmrnj\") pod \"5e3a5c49-400c-4550-888b-87f763daca59\" (UID: \"5e3a5c49-400c-4550-888b-87f763daca59\") "
Jul 07 18:51:33.413731 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.412298    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-registry-certificates\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:51:33.413731 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.412317    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e3a5c49-400c-4550-888b-87f763daca59-trusted-ca\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:51:33.415846 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.415802    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5e3a5c49-400c-4550-888b-87f763daca59" (UID: "5e3a5c49-400c-4550-888b-87f763daca59"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:51:33.416117 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.415944    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-kube-api-access-rmrnj" (OuterVolumeSpecName: "kube-api-access-rmrnj") pod "5e3a5c49-400c-4550-888b-87f763daca59" (UID: "5e3a5c49-400c-4550-888b-87f763daca59"). InnerVolumeSpecName "kube-api-access-rmrnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:51:33.416268 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.416158    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5e3a5c49-400c-4550-888b-87f763daca59" (UID: "5e3a5c49-400c-4550-888b-87f763daca59"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:51:33.416339 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.416323    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5e3a5c49-400c-4550-888b-87f763daca59" (UID: "5e3a5c49-400c-4550-888b-87f763daca59"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:51:33.416775 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.416752    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5e3a5c49-400c-4550-888b-87f763daca59" (UID: "5e3a5c49-400c-4550-888b-87f763daca59"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:51:33.421948 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.421928    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3a5c49-400c-4550-888b-87f763daca59-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5e3a5c49-400c-4550-888b-87f763daca59" (UID: "5e3a5c49-400c-4550-888b-87f763daca59"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:33.513573 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.513547    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-installation-pull-secrets\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:51:33.513573 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.513569    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e3a5c49-400c-4550-888b-87f763daca59-image-registry-private-configuration\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:51:33.513699 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.513580    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-registry-tls\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:51:33.513699 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.513588    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e3a5c49-400c-4550-888b-87f763daca59-ca-trust-extracted\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:51:33.513699 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.513596    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmrnj\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-kube-api-access-rmrnj\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:51:33.513699 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.513605    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e3a5c49-400c-4550-888b-87f763daca59-bound-sa-token\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:51:33.613515 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.613447    2577 generic.go:356] "Generic (PLEG): container finished" podID="5e3a5c49-400c-4550-888b-87f763daca59" containerID="ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49" exitCode=0
Jul 07 18:51:33.613615 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.613507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn" event={"ID":"5e3a5c49-400c-4550-888b-87f763daca59","Type":"ContainerDied","Data":"ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49"}
Jul 07 18:51:33.613615 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.613542    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn"
Jul 07 18:51:33.613615 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.613562    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b5cc8dccf-6phqn" event={"ID":"5e3a5c49-400c-4550-888b-87f763daca59","Type":"ContainerDied","Data":"d7c83388bda9dc8a3b575f8bc9e2617deb293257ac7946ba7ad547a909e34ea0"}
Jul 07 18:51:33.613615 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.613608    2577 scope.go:117] "RemoveContainer" containerID="ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49"
Jul 07 18:51:33.622045 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.621931    2577 scope.go:117] "RemoveContainer" containerID="ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49"
Jul 07 18:51:33.622219 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:51:33.622200    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49\": container with ID starting with ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49 not found: ID does not exist" containerID="ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49"
Jul 07 18:51:33.622264 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.622226    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49"} err="failed to get container status \"ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49\": rpc error: code = NotFound desc = could not find container \"ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49\": container with ID starting with ceb491642491578f3a4b7c6c604eae147860b8c7da9fce574e3504055b86ea49 not found: ID does not exist"
Jul 07 18:51:33.649453 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.649431    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b5cc8dccf-6phqn"]
Jul 07 18:51:33.658305 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:33.658287    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b5cc8dccf-6phqn"]
Jul 07 18:51:35.002724 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:35.002695    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3a5c49-400c-4550-888b-87f763daca59" path="/var/lib/kubelet/pods/5e3a5c49-400c-4550-888b-87f763daca59/volumes"
Jul 07 18:51:37.161388 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:37.161347    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:37.263157 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:37.263126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:37.364366 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:37.364334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:39.598882 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:39.598852    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:39.695781 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:39.695747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:39.801316 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:39.801284    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:39.896565 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:39.896502    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:39.949773 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:39.949745    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:41.065272 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:41.065222    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:41.125365 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:41.125339    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:43.246919 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:43.246885    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:43.351007 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:43.350977    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:43.447592 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:43.447564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:50.567014 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:51:50.566989    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-59xj2"
Jul 07 18:52:02.043727 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:02.043693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:02.142622 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:02.142590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:19.694534 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:19.694496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:19.754310 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:19.754282    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:33.381394 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:33.381359    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:33.472212 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:33.472183    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:38.004890 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:38.004855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:38.072319 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:38.072283    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:38.148870 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:38.148838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:38.206265 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:38.206233    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:38.752493 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:38.752451    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:38.852711 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:38.852675    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:45.283092 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:45.283052    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:45.384796 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:45.384766    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:48.738160 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:48.738125    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:49.081553 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:49.081518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:49.138527 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:49.138503    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:49.202585 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:49.202559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:49.302540 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:52:49.302514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:01.779917 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:01.779826    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:22.964711 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:22.964676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:23.065445 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:23.065390    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:38.363636 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:38.363597    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:41.813841 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:41.813802    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:41.879547 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:41.879519    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:49.787625 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:49.787586    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:50.613507 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:50.613472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:53.256687 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:53.256645    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:53.357997 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:53.357969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:54.530605 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:54.530576    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:54.636486 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:54.636456    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:55.529876 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:55.529843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:55.783993 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:55.783898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:57.351378 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:57.351347    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:57.945374 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:53:57.945341    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:00.254663 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:00.254626    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:00.319951 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:00.319921    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:06.733868 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:06.733838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:07.726574 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:07.726538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:07.846878 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:07.846850    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:13.055848 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:13.055815    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:13.151646 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:13.151612    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:14.970392 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:14.970349    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:16.994694 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:16.994633    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:17.053121 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:17.053075    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:17.590313 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:17.590270    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:30.768737 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:30.768639    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:30.879136 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:30.879101    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:31.387593 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.387560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:31.649848 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.649776    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:31.762284 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.762253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:31.810681 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.810652    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"]
Jul 07 18:54:31.811221 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.810895    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3a5c49-400c-4550-888b-87f763daca59" containerName="registry"
Jul 07 18:54:31.811221 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.810905    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3a5c49-400c-4550-888b-87f763daca59" containerName="registry"
Jul 07 18:54:31.811221 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.810955    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3a5c49-400c-4550-888b-87f763daca59" containerName="registry"
Jul 07 18:54:31.816112 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.816089    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.820220 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.820203    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 18:54:31.820220 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.820212    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 18:54:31.821748 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.821725    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 18:54:31.821869 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.821778    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gw8f5\""
Jul 07 18:54:31.821869 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.821851    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 18:54:31.834204 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.834184    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"]
Jul 07 18:54:31.885666 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.885649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d8949cd-270d-4b42-9db0-6410b0626fa8-webhook-cert\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.885768 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.885676    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d8949cd-270d-4b42-9db0-6410b0626fa8-manifests\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.885768 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.885698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d8949cd-270d-4b42-9db0-6410b0626fa8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.885768 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.885717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2m4h\" (UniqueName: \"kubernetes.io/projected/3d8949cd-270d-4b42-9db0-6410b0626fa8-kube-api-access-b2m4h\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.885768 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.885734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d8949cd-270d-4b42-9db0-6410b0626fa8-tmp\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.963573 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.963514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:31.986515 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.986493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d8949cd-270d-4b42-9db0-6410b0626fa8-webhook-cert\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.986593 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.986523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d8949cd-270d-4b42-9db0-6410b0626fa8-manifests\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.986593 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.986546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d8949cd-270d-4b42-9db0-6410b0626fa8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.986593 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.986562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2m4h\" (UniqueName: \"kubernetes.io/projected/3d8949cd-270d-4b42-9db0-6410b0626fa8-kube-api-access-b2m4h\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.986593 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.986581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d8949cd-270d-4b42-9db0-6410b0626fa8-tmp\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.986964 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.986935    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d8949cd-270d-4b42-9db0-6410b0626fa8-manifests\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.988898 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.988867    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d8949cd-270d-4b42-9db0-6410b0626fa8-tmp\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.989036 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.989017    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d8949cd-270d-4b42-9db0-6410b0626fa8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.989111 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.989101    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d8949cd-270d-4b42-9db0-6410b0626fa8-webhook-cert\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:31.996785 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:31.996765    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2m4h\" (UniqueName: \"kubernetes.io/projected/3d8949cd-270d-4b42-9db0-6410b0626fa8-kube-api-access-b2m4h\") pod \"opendatahub-operator-controller-manager-64dd56d745-86zxr\" (UID: \"3d8949cd-270d-4b42-9db0-6410b0626fa8\") " pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:32.064813 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:32.064787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:32.125780 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:32.125756    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:32.180826 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:32.180734    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:32.255468 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:32.255438    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"]
Jul 07 18:54:32.258381 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:54:32.258359    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8949cd_270d_4b42_9db0_6410b0626fa8.slice/crio-4a20b88269c28596a0819fe075662b7e84d0b0fa17f328b32ddd846fc08a8292 WatchSource:0}: Error finding container 4a20b88269c28596a0819fe075662b7e84d0b0fa17f328b32ddd846fc08a8292: Status 404 returned error can't find the container with id 4a20b88269c28596a0819fe075662b7e84d0b0fa17f328b32ddd846fc08a8292
Jul 07 18:54:32.291329 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:32.291302    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:32.391020 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:32.390964    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:32.534321 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:32.534246    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:33.196493 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:33.196455    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr" event={"ID":"3d8949cd-270d-4b42-9db0-6410b0626fa8","Type":"ContainerStarted","Data":"4a20b88269c28596a0819fe075662b7e84d0b0fa17f328b32ddd846fc08a8292"}
Jul 07 18:54:35.206390 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:35.206312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr" event={"ID":"3d8949cd-270d-4b42-9db0-6410b0626fa8","Type":"ContainerStarted","Data":"644996097b11cd483eb9f2a13b84d6d29b21cc565b00f9653bd35a69cac19548"}
Jul 07 18:54:36.212037 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:36.212004    2577 generic.go:356] "Generic (PLEG): container finished" podID="3d8949cd-270d-4b42-9db0-6410b0626fa8" containerID="644996097b11cd483eb9f2a13b84d6d29b21cc565b00f9653bd35a69cac19548" exitCode=0
Jul 07 18:54:36.212478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:36.212069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr" event={"ID":"3d8949cd-270d-4b42-9db0-6410b0626fa8","Type":"ContainerDied","Data":"644996097b11cd483eb9f2a13b84d6d29b21cc565b00f9653bd35a69cac19548"}
Jul 07 18:54:37.217965 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:37.217929    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr" event={"ID":"3d8949cd-270d-4b42-9db0-6410b0626fa8","Type":"ContainerStarted","Data":"8fff3172a8f45c5436e37c040f63fd004b65e8726d8ce72cf6f79011dbd4d964"}
Jul 07 18:54:37.218340 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:37.218084    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:37.247686 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:37.247639    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr" podStartSLOduration=1.9907954719999998 podStartE2EDuration="6.247623852s" totalImagesPullingTime="3.163024759s" totalInitContainerRuntime="1.093803621s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:37.247146287 +0000 UTC m=+273.013253659" watchObservedRunningTime="2026-07-07 18:54:37.247623852 +0000 UTC m=+273.013731225"
Jul 07 18:54:48.224340 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:48.224310    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64dd56d745-86zxr"
Jul 07 18:54:50.803073 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:50.803032    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:50.895342 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:50.895296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:51.228073 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.227984    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:51.294613 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.294583    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"]
Jul 07 18:54:51.304701 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.304653    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.308493 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.308470    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 18:54:51.309683 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.309659    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2kxfm\""
Jul 07 18:54:51.309683 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.309666    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 18:54:51.309856 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.309700    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 18:54:51.309856 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.309761    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 18:54:51.318181 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.318160    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"]
Jul 07 18:54:51.371042 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.371017    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:51.419689 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.419667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89c4d960-5ef6-45d3-ac9e-da70008811db-tls-certs\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.419811 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.419713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gcf2\" (UniqueName: \"kubernetes.io/projected/89c4d960-5ef6-45d3-ac9e-da70008811db-kube-api-access-6gcf2\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.419811 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.419767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89c4d960-5ef6-45d3-ac9e-da70008811db-tmp\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.520929 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.520906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gcf2\" (UniqueName: \"kubernetes.io/projected/89c4d960-5ef6-45d3-ac9e-da70008811db-kube-api-access-6gcf2\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.521054 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.520940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89c4d960-5ef6-45d3-ac9e-da70008811db-tmp\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.521129 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.521075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89c4d960-5ef6-45d3-ac9e-da70008811db-tls-certs\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.523121 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.523098    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89c4d960-5ef6-45d3-ac9e-da70008811db-tmp\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.523436 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.523403    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89c4d960-5ef6-45d3-ac9e-da70008811db-tls-certs\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.534116 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.534082    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gcf2\" (UniqueName: \"kubernetes.io/projected/89c4d960-5ef6-45d3-ac9e-da70008811db-kube-api-access-6gcf2\") pod \"kube-auth-proxy-5598bb98cc-7l4gw\" (UID: \"89c4d960-5ef6-45d3-ac9e-da70008811db\") " pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.615222 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.615195    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"
Jul 07 18:54:51.675801 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.675756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:51.770495 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.770474    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw"]
Jul 07 18:54:51.772368 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:54:51.772311    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c4d960_5ef6_45d3_ac9e_da70008811db.slice/crio-03abaeae9f0f50af09ca923de08c5fa1ccb2994df7fe6bf2748879b646f6b583 WatchSource:0}: Error finding container 03abaeae9f0f50af09ca923de08c5fa1ccb2994df7fe6bf2748879b646f6b583: Status 404 returned error can't find the container with id 03abaeae9f0f50af09ca923de08c5fa1ccb2994df7fe6bf2748879b646f6b583
Jul 07 18:54:51.804903 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.804873    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:51.913705 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:51.913661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:52.096631 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:52.096527    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:52.275123 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:52.275083    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw" event={"ID":"89c4d960-5ef6-45d3-ac9e-da70008811db","Type":"ContainerStarted","Data":"03abaeae9f0f50af09ca923de08c5fa1ccb2994df7fe6bf2748879b646f6b583"}
Jul 07 18:54:52.858141 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:52.858103    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:52.973511 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:52.973469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:53.191636 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.191530    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:53.291683 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.291628    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:53.836009 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.835965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:53.940955 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.940900    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:53.945406 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.945373    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"]
Jul 07 18:54:53.948321 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.948301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:53.952341 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.952319    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:54:53.952468 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.952390    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 18:54:53.952468 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.952390    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 18:54:53.954044 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.953998    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 18:54:53.954151 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.953998    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 18:54:53.954151 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.954061    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mg5k7\""
Jul 07 18:54:53.959870 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:53.959839    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"]
Jul 07 18:54:54.041871 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.041835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02eb83dc-f3f7-41d6-b247-96d27fabe23d-cert\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.042058 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.041896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdff2\" (UniqueName: \"kubernetes.io/projected/02eb83dc-f3f7-41d6-b247-96d27fabe23d-kube-api-access-wdff2\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.042058 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.041973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02eb83dc-f3f7-41d6-b247-96d27fabe23d-metrics-cert\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.042058 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.042012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02eb83dc-f3f7-41d6-b247-96d27fabe23d-manager-config\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.143382 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.143303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02eb83dc-f3f7-41d6-b247-96d27fabe23d-metrics-cert\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.143382 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.143347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02eb83dc-f3f7-41d6-b247-96d27fabe23d-manager-config\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.143721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.143481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02eb83dc-f3f7-41d6-b247-96d27fabe23d-cert\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.143721 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.143555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdff2\" (UniqueName: \"kubernetes.io/projected/02eb83dc-f3f7-41d6-b247-96d27fabe23d-kube-api-access-wdff2\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.144540 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.144512    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02eb83dc-f3f7-41d6-b247-96d27fabe23d-manager-config\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.146736 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.146709    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02eb83dc-f3f7-41d6-b247-96d27fabe23d-metrics-cert\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.147003 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.146983    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02eb83dc-f3f7-41d6-b247-96d27fabe23d-cert\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.158665 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.158639    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdff2\" (UniqueName: \"kubernetes.io/projected/02eb83dc-f3f7-41d6-b247-96d27fabe23d-kube-api-access-wdff2\") pod \"lws-controller-manager-759f8b6db6-jdwth\" (UID: \"02eb83dc-f3f7-41d6-b247-96d27fabe23d\") " pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.261674 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.261638    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:54.438926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.438894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"]
Jul 07 18:54:54.441705 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:54:54.441678    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02eb83dc_f3f7_41d6_b247_96d27fabe23d.slice/crio-f7cfdb2fc73f057a8e836e7b87ede70455ebf5665223644e8adaa7ff9ad0db84 WatchSource:0}: Error finding container f7cfdb2fc73f057a8e836e7b87ede70455ebf5665223644e8adaa7ff9ad0db84: Status 404 returned error can't find the container with id f7cfdb2fc73f057a8e836e7b87ede70455ebf5665223644e8adaa7ff9ad0db84
Jul 07 18:54:54.858335 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:54.858296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:55.294939 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:55.294903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw" event={"ID":"89c4d960-5ef6-45d3-ac9e-da70008811db","Type":"ContainerStarted","Data":"9397c47516d78857421892d48cfcf1ae893440c86c93beff06649aae5e17443f"}
Jul 07 18:54:55.296674 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:55.296642    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth" event={"ID":"02eb83dc-f3f7-41d6-b247-96d27fabe23d","Type":"ContainerStarted","Data":"f7cfdb2fc73f057a8e836e7b87ede70455ebf5665223644e8adaa7ff9ad0db84"}
Jul 07 18:54:57.305914 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:57.305877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth" event={"ID":"02eb83dc-f3f7-41d6-b247-96d27fabe23d","Type":"ContainerStarted","Data":"5bec263bfbdaa30ea375ee9d51bebb71414f2002bbab999e943f8d9fbc0d40a9"}
Jul 07 18:54:57.306276 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:57.305955    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:54:57.337099 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:57.337036    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5598bb98cc-7l4gw" podStartSLOduration=3.778596318 podStartE2EDuration="6.337016126s" totalImagesPullingTime="2.558419808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:55.321434955 +0000 UTC m=+291.087542322" watchObservedRunningTime="2026-07-07 18:54:57.337016126 +0000 UTC m=+293.103123511"
Jul 07 18:54:57.337474 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:57.337433    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth" podStartSLOduration=2.149804827 podStartE2EDuration="4.337391307s" totalImagesPullingTime="2.18758648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:57.334651886 +0000 UTC m=+293.100759256" watchObservedRunningTime="2026-07-07 18:54:57.337391307 +0000 UTC m=+293.103498681"
Jul 07 18:54:58.159224 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:58.159191    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:58.302434 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:58.302380    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:59.198539 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:59.198503    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:59.284523 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:59.284492    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:59.385781 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:54:59.385744    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:01.800009 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:01.799974    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:01.944462 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:01.944429    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:03.610574 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:03.610541    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:03.725894 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:03.725852    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:03.913670 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:03.913592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:04.086706 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:04.086673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:04.742917 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:04.742886    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 18:55:04.748394 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:04.748367    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 18:55:04.756691 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:04.756662    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 18:55:04.996167 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:04.996103    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:05.262505 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:05.262408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:08.312043 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:08.312013    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-759f8b6db6-jdwth"
Jul 07 18:55:52.325786 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:52.325724    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:52.419607 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:52.419572    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:52.570763 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:55:52.570733    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:21.262881 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:21.262795    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:25.135098 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:25.135054    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:26.657919 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:26.657881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:28.285429 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:28.285387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:28.693739 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:28.693629    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:30.109800 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:30.109768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:31.683297 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:31.683267    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:32.564312 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:32.564277    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:32.676083 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:32.676046    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:34.500653 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:34.500625    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:35.542573 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:35.542530    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:35.892796 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:35.892706    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:36.279516 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:36.279482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:36.397537 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:36.397507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:43.906325 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:43.906289    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:44.007519 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:44.007485    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:47.403177 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:47.403140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:47.505568 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:47.505512    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:47.602822 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:47.602797    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:48.746203 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:48.746170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:48.863301 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:48.863273    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:51.127554 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:51.127518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:51.222983 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:51.222950    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:56.677616 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:56.677579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:56.807977 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:56:56.807954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:03.545461 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:03.545426    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:03.648430 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:03.648384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:08.354313 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:08.354276    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:08.457319 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:08.457284    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:10.882463 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:10.882408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:10.981946 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:10.981915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:16.557177 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:16.557139    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:16.716599 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:16.716562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:24.540821 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:24.540782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:24.641071 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:24.641039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:26.893397 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:26.893319    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:27.011371 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:27.011312    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:28.752659 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:28.752618    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:28.871741 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:28.871693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:28.973730 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:28.973697    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:29.140476 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.140389    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:29.226185 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.226148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:29.346509 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.346484    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:29.446734 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.446650    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:29.639944 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.639917    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mt22j"]
Jul 07 18:57:29.642953 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.642932    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mt22j"
Jul 07 18:57:29.646077 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.646058    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:57:29.647386 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.647366    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dpqgb\""
Jul 07 18:57:29.647483 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.647405    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:57:29.658647 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.658628    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8zbs7"]
Jul 07 18:57:29.661706 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.661684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mt22j"]
Jul 07 18:57:29.661799 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.661787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8zbs7"
Jul 07 18:57:29.671357 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.671337    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8zbs7"]
Jul 07 18:57:29.677854 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.677826    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:29.752328 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.752304    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:29.758421 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.758390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t75zb\" (UniqueName: \"kubernetes.io/projected/c103c857-4b81-47da-b8d9-0605360216c6-kube-api-access-t75zb\") pod \"authorino-58cd955675-mt22j\" (UID: \"c103c857-4b81-47da-b8d9-0605360216c6\") " pod="kuadrant-system/authorino-58cd955675-mt22j"
Jul 07 18:57:29.758697 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.758449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mppl\" (UniqueName: \"kubernetes.io/projected/2d020083-cc7b-4359-b493-739ba052d397-kube-api-access-9mppl\") pod \"authorino-75d556bd77-8zbs7\" (UID: \"2d020083-cc7b-4359-b493-739ba052d397\") " pod="kuadrant-system/authorino-75d556bd77-8zbs7"
Jul 07 18:57:29.859836 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.859810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mppl\" (UniqueName: \"kubernetes.io/projected/2d020083-cc7b-4359-b493-739ba052d397-kube-api-access-9mppl\") pod \"authorino-75d556bd77-8zbs7\" (UID: \"2d020083-cc7b-4359-b493-739ba052d397\") " pod="kuadrant-system/authorino-75d556bd77-8zbs7"
Jul 07 18:57:29.859929 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.859884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t75zb\" (UniqueName: \"kubernetes.io/projected/c103c857-4b81-47da-b8d9-0605360216c6-kube-api-access-t75zb\") pod \"authorino-58cd955675-mt22j\" (UID: \"c103c857-4b81-47da-b8d9-0605360216c6\") " pod="kuadrant-system/authorino-58cd955675-mt22j"
Jul 07 18:57:29.870176 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.870148    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t75zb\" (UniqueName: \"kubernetes.io/projected/c103c857-4b81-47da-b8d9-0605360216c6-kube-api-access-t75zb\") pod \"authorino-58cd955675-mt22j\" (UID: \"c103c857-4b81-47da-b8d9-0605360216c6\") " pod="kuadrant-system/authorino-58cd955675-mt22j"
Jul 07 18:57:29.870306 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.870285    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mppl\" (UniqueName: \"kubernetes.io/projected/2d020083-cc7b-4359-b493-739ba052d397-kube-api-access-9mppl\") pod \"authorino-75d556bd77-8zbs7\" (UID: \"2d020083-cc7b-4359-b493-739ba052d397\") " pod="kuadrant-system/authorino-75d556bd77-8zbs7"
Jul 07 18:57:29.952251 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.952232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mt22j"
Jul 07 18:57:29.970127 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:29.970104    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8zbs7"
Jul 07 18:57:30.088692 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:30.088668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mt22j"]
Jul 07 18:57:30.091164 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:57:30.091136    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc103c857_4b81_47da_b8d9_0605360216c6.slice/crio-e199212797f3ecd36f81c94aaa6e0ed99f5e8a7ea37a92165990d3858829053d WatchSource:0}: Error finding container e199212797f3ecd36f81c94aaa6e0ed99f5e8a7ea37a92165990d3858829053d: Status 404 returned error can't find the container with id e199212797f3ecd36f81c94aaa6e0ed99f5e8a7ea37a92165990d3858829053d
Jul 07 18:57:30.092507 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:30.092490    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:57:30.105917 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:30.105893    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8zbs7"]
Jul 07 18:57:30.108214 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:57:30.108192    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d020083_cc7b_4359_b493_739ba052d397.slice/crio-7559e44b36f6e97acc6076263c8b3cf332bac114b020fcd194491563a57cde3e WatchSource:0}: Error finding container 7559e44b36f6e97acc6076263c8b3cf332bac114b020fcd194491563a57cde3e: Status 404 returned error can't find the container with id 7559e44b36f6e97acc6076263c8b3cf332bac114b020fcd194491563a57cde3e
Jul 07 18:57:30.844647 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:30.844608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8zbs7" event={"ID":"2d020083-cc7b-4359-b493-739ba052d397","Type":"ContainerStarted","Data":"7559e44b36f6e97acc6076263c8b3cf332bac114b020fcd194491563a57cde3e"}
Jul 07 18:57:30.848478 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:30.848408    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mt22j" event={"ID":"c103c857-4b81-47da-b8d9-0605360216c6","Type":"ContainerStarted","Data":"e199212797f3ecd36f81c94aaa6e0ed99f5e8a7ea37a92165990d3858829053d"}
Jul 07 18:57:32.137891 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:32.137863    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:32.253934 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:32.253890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:57:33.864614 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:33.864517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8zbs7" event={"ID":"2d020083-cc7b-4359-b493-739ba052d397","Type":"ContainerStarted","Data":"eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33"}
Jul 07 18:57:33.865926 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:33.865892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mt22j" event={"ID":"c103c857-4b81-47da-b8d9-0605360216c6","Type":"ContainerStarted","Data":"003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc"}
Jul 07 18:57:33.883098 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:33.883051    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8zbs7" podStartSLOduration=1.428912598 podStartE2EDuration="4.883036723s" totalImagesPullingTime="3.454124125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:33.881694916 +0000 UTC m=+449.647802290" watchObservedRunningTime="2026-07-07 18:57:33.883036723 +0000 UTC m=+449.649144095"
Jul 07 18:57:33.897641 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:33.897601    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mt22j" podStartSLOduration=1.416127957 podStartE2EDuration="4.897587038s" totalImagesPullingTime="3.481459081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:33.89620842 +0000 UTC m=+449.662315794" watchObservedRunningTime="2026-07-07 18:57:33.897587038 +0000 UTC m=+449.663694423"
Jul 07 18:57:33.920002 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:33.919979    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mt22j"]
Jul 07 18:57:35.872709 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:35.872669    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mt22j" podUID="c103c857-4b81-47da-b8d9-0605360216c6" containerName="authorino" containerID="cri-o://003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc" gracePeriod=30
Jul 07 18:57:36.112301 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.112278    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mt22j"
Jul 07 18:57:36.214011 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.213931    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t75zb\" (UniqueName: \"kubernetes.io/projected/c103c857-4b81-47da-b8d9-0605360216c6-kube-api-access-t75zb\") pod \"c103c857-4b81-47da-b8d9-0605360216c6\" (UID: \"c103c857-4b81-47da-b8d9-0605360216c6\") "
Jul 07 18:57:36.216056 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.216031    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c103c857-4b81-47da-b8d9-0605360216c6-kube-api-access-t75zb" (OuterVolumeSpecName: "kube-api-access-t75zb") pod "c103c857-4b81-47da-b8d9-0605360216c6" (UID: "c103c857-4b81-47da-b8d9-0605360216c6"). InnerVolumeSpecName "kube-api-access-t75zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:57:36.315105 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.315077    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t75zb\" (UniqueName: \"kubernetes.io/projected/c103c857-4b81-47da-b8d9-0605360216c6-kube-api-access-t75zb\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:57:36.877626 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.877590    2577 generic.go:356] "Generic (PLEG): container finished" podID="c103c857-4b81-47da-b8d9-0605360216c6" containerID="003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc" exitCode=0
Jul 07 18:57:36.878061 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.877636    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mt22j"
Jul 07 18:57:36.878061 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.877671    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mt22j" event={"ID":"c103c857-4b81-47da-b8d9-0605360216c6","Type":"ContainerDied","Data":"003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc"}
Jul 07 18:57:36.878061 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.877715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mt22j" event={"ID":"c103c857-4b81-47da-b8d9-0605360216c6","Type":"ContainerDied","Data":"e199212797f3ecd36f81c94aaa6e0ed99f5e8a7ea37a92165990d3858829053d"}
Jul 07 18:57:36.878061 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.877741    2577 scope.go:117] "RemoveContainer" containerID="003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc"
Jul 07 18:57:36.886260 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.886191    2577 scope.go:117] "RemoveContainer" containerID="003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc"
Jul 07 18:57:36.886500 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:57:36.886478    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc\": container with ID starting with 003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc not found: ID does not exist" containerID="003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc"
Jul 07 18:57:36.886542 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.886513    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc"} err="failed to get container status \"003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc\": rpc error: code = NotFound desc = could not find container \"003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc\": container with ID starting with 003e150740e1d57909a33875995f733e114a2459f2c50d424b4dfc605c42b5dc not found: ID does not exist"
Jul 07 18:57:36.900315 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.900290    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mt22j"]
Jul 07 18:57:36.902675 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:36.902650    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mt22j"]
Jul 07 18:57:37.003678 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:37.003658    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c103c857-4b81-47da-b8d9-0605360216c6" path="/var/lib/kubelet/pods/c103c857-4b81-47da-b8d9-0605360216c6/volumes"
Jul 07 18:57:50.505891 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:57:50.505853    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:02.988797 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:02.988765    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:03.232723 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.232691    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7zfk7"]
Jul 07 18:58:03.232961 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.232949    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c103c857-4b81-47da-b8d9-0605360216c6" containerName="authorino"
Jul 07 18:58:03.233002 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.232963    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c103c857-4b81-47da-b8d9-0605360216c6" containerName="authorino"
Jul 07 18:58:03.233041 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.233020    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c103c857-4b81-47da-b8d9-0605360216c6" containerName="authorino"
Jul 07 18:58:03.235843 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.235827    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7zfk7"
Jul 07 18:58:03.245860 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.245841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7zfk7"]
Jul 07 18:58:03.275493 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.275469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:03.403203 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.403177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldz6b\" (UniqueName: \"kubernetes.io/projected/ed8d48ce-5728-4e31-9c7b-e0ee1500d557-kube-api-access-ldz6b\") pod \"authorino-5d4b67c446-7zfk7\" (UID: \"ed8d48ce-5728-4e31-9c7b-e0ee1500d557\") " pod="kuadrant-system/authorino-5d4b67c446-7zfk7"
Jul 07 18:58:03.483035 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.483009    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7zfk7"]
Jul 07 18:58:03.483212 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:58:03.483194    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ldz6b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-7zfk7" podUID="ed8d48ce-5728-4e31-9c7b-e0ee1500d557"
Jul 07 18:58:03.503441 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.503359    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7df79b7b84-g8dch"]
Jul 07 18:58:03.503612 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.503592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz6b\" (UniqueName: \"kubernetes.io/projected/ed8d48ce-5728-4e31-9c7b-e0ee1500d557-kube-api-access-ldz6b\") pod \"authorino-5d4b67c446-7zfk7\" (UID: \"ed8d48ce-5728-4e31-9c7b-e0ee1500d557\") " pod="kuadrant-system/authorino-5d4b67c446-7zfk7"
Jul 07 18:58:03.506613 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.506596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df79b7b84-g8dch"
Jul 07 18:58:03.513848 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.513817    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7df79b7b84-g8dch"]
Jul 07 18:58:03.516908 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.516887    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldz6b\" (UniqueName: \"kubernetes.io/projected/ed8d48ce-5728-4e31-9c7b-e0ee1500d557-kube-api-access-ldz6b\") pod \"authorino-5d4b67c446-7zfk7\" (UID: \"ed8d48ce-5728-4e31-9c7b-e0ee1500d557\") " pod="kuadrant-system/authorino-5d4b67c446-7zfk7"
Jul 07 18:58:03.599066 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.599041    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7df79b7b84-g8dch"]
Jul 07 18:58:03.599235 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:58:03.599219    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ttrjg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7df79b7b84-g8dch" podUID="e7f0a7cc-e0bc-457c-b389-322809c589c7"
Jul 07 18:58:03.604091 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.604072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/e7f0a7cc-e0bc-457c-b389-322809c589c7-kube-api-access-ttrjg\") pod \"authorino-7df79b7b84-g8dch\" (UID: \"e7f0a7cc-e0bc-457c-b389-322809c589c7\") " pod="kuadrant-system/authorino-7df79b7b84-g8dch"
Jul 07 18:58:03.630531 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.630503    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-685fc465b4-shfkd"]
Jul 07 18:58:03.633455 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.633432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 18:58:03.636049 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.636031    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 18:58:03.641757 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.641736    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-685fc465b4-shfkd"]
Jul 07 18:58:03.704669 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.704644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/e7f0a7cc-e0bc-457c-b389-322809c589c7-kube-api-access-ttrjg\") pod \"authorino-7df79b7b84-g8dch\" (UID: \"e7f0a7cc-e0bc-457c-b389-322809c589c7\") " pod="kuadrant-system/authorino-7df79b7b84-g8dch"
Jul 07 18:58:03.713629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.713604    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/e7f0a7cc-e0bc-457c-b389-322809c589c7-kube-api-access-ttrjg\") pod \"authorino-7df79b7b84-g8dch\" (UID: \"e7f0a7cc-e0bc-457c-b389-322809c589c7\") " pod="kuadrant-system/authorino-7df79b7b84-g8dch"
Jul 07 18:58:03.805753 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.805685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vl6v\" (UniqueName: \"kubernetes.io/projected/fa041ea6-d659-4f2f-a356-5d0ec171623a-kube-api-access-5vl6v\") pod \"authorino-685fc465b4-shfkd\" (UID: \"fa041ea6-d659-4f2f-a356-5d0ec171623a\") " pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 18:58:03.805753 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.805725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa041ea6-d659-4f2f-a356-5d0ec171623a-tls-cert\") pod \"authorino-685fc465b4-shfkd\" (UID: \"fa041ea6-d659-4f2f-a356-5d0ec171623a\") " pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 18:58:03.906629 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.906604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vl6v\" (UniqueName: \"kubernetes.io/projected/fa041ea6-d659-4f2f-a356-5d0ec171623a-kube-api-access-5vl6v\") pod \"authorino-685fc465b4-shfkd\" (UID: \"fa041ea6-d659-4f2f-a356-5d0ec171623a\") " pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 18:58:03.906728 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.906637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa041ea6-d659-4f2f-a356-5d0ec171623a-tls-cert\") pod \"authorino-685fc465b4-shfkd\" (UID: \"fa041ea6-d659-4f2f-a356-5d0ec171623a\") " pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 18:58:03.908890 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.908864    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa041ea6-d659-4f2f-a356-5d0ec171623a-tls-cert\") pod \"authorino-685fc465b4-shfkd\" (UID: \"fa041ea6-d659-4f2f-a356-5d0ec171623a\") " pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 18:58:03.915579 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.915558    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vl6v\" (UniqueName: \"kubernetes.io/projected/fa041ea6-d659-4f2f-a356-5d0ec171623a-kube-api-access-5vl6v\") pod \"authorino-685fc465b4-shfkd\" (UID: \"fa041ea6-d659-4f2f-a356-5d0ec171623a\") " pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 18:58:03.942458 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.942429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 18:58:03.990859 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.990830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7zfk7"
Jul 07 18:58:03.991175 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.990830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df79b7b84-g8dch"
Jul 07 18:58:03.998819 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:03.998794    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7zfk7"
Jul 07 18:58:04.001786 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.001761    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df79b7b84-g8dch"
Jul 07 18:58:04.067242 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.067181    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-685fc465b4-shfkd"]
Jul 07 18:58:04.070247 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:58:04.070225    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa041ea6_d659_4f2f_a356_5d0ec171623a.slice/crio-a4864fec25f0299500c9726cb9a19ebd58104d2de18f688be47d6fc592a347e2 WatchSource:0}: Error finding container a4864fec25f0299500c9726cb9a19ebd58104d2de18f688be47d6fc592a347e2: Status 404 returned error can't find the container with id a4864fec25f0299500c9726cb9a19ebd58104d2de18f688be47d6fc592a347e2
Jul 07 18:58:04.108381 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.108357    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldz6b\" (UniqueName: \"kubernetes.io/projected/ed8d48ce-5728-4e31-9c7b-e0ee1500d557-kube-api-access-ldz6b\") pod \"ed8d48ce-5728-4e31-9c7b-e0ee1500d557\" (UID: \"ed8d48ce-5728-4e31-9c7b-e0ee1500d557\") "
Jul 07 18:58:04.108498 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.108396    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/e7f0a7cc-e0bc-457c-b389-322809c589c7-kube-api-access-ttrjg\") pod \"e7f0a7cc-e0bc-457c-b389-322809c589c7\" (UID: \"e7f0a7cc-e0bc-457c-b389-322809c589c7\") "
Jul 07 18:58:04.110505 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.110477    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed8d48ce-5728-4e31-9c7b-e0ee1500d557-kube-api-access-ldz6b" (OuterVolumeSpecName: "kube-api-access-ldz6b") pod "ed8d48ce-5728-4e31-9c7b-e0ee1500d557" (UID: "ed8d48ce-5728-4e31-9c7b-e0ee1500d557"). InnerVolumeSpecName "kube-api-access-ldz6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:04.110505 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.110488    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7f0a7cc-e0bc-457c-b389-322809c589c7-kube-api-access-ttrjg" (OuterVolumeSpecName: "kube-api-access-ttrjg") pod "e7f0a7cc-e0bc-457c-b389-322809c589c7" (UID: "e7f0a7cc-e0bc-457c-b389-322809c589c7"). InnerVolumeSpecName "kube-api-access-ttrjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:04.209474 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.209446    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/e7f0a7cc-e0bc-457c-b389-322809c589c7-kube-api-access-ttrjg\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:58:04.209474 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.209470    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldz6b\" (UniqueName: \"kubernetes.io/projected/ed8d48ce-5728-4e31-9c7b-e0ee1500d557-kube-api-access-ldz6b\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:58:04.995058 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.995018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685fc465b4-shfkd" event={"ID":"fa041ea6-d659-4f2f-a356-5d0ec171623a","Type":"ContainerStarted","Data":"fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed"}
Jul 07 18:58:04.995433 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.995066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685fc465b4-shfkd" event={"ID":"fa041ea6-d659-4f2f-a356-5d0ec171623a","Type":"ContainerStarted","Data":"a4864fec25f0299500c9726cb9a19ebd58104d2de18f688be47d6fc592a347e2"}
Jul 07 18:58:04.995433 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.995127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df79b7b84-g8dch"
Jul 07 18:58:04.995433 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:04.995251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7zfk7"
Jul 07 18:58:05.013060 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.013018    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-685fc465b4-shfkd" podStartSLOduration=1.626416039 podStartE2EDuration="2.013005876s" totalImagesPullingTime="386.589837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:05.012370734 +0000 UTC m=+480.778478108" watchObservedRunningTime="2026-07-07 18:58:05.013005876 +0000 UTC m=+480.779113252"
Jul 07 18:58:05.037561 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.037498    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7zfk7"]
Jul 07 18:58:05.044446 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.044405    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8zbs7"]
Jul 07 18:58:05.044652 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.044628    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8zbs7" podUID="2d020083-cc7b-4359-b493-739ba052d397" containerName="authorino" containerID="cri-o://eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33" gracePeriod=30
Jul 07 18:58:05.046872 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.046852    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7zfk7"]
Jul 07 18:58:05.067535 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.067515    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7df79b7b84-g8dch"]
Jul 07 18:58:05.074159 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.074133    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7df79b7b84-g8dch"]
Jul 07 18:58:05.281678 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.281651    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8zbs7"
Jul 07 18:58:05.419701 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.419637    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mppl\" (UniqueName: \"kubernetes.io/projected/2d020083-cc7b-4359-b493-739ba052d397-kube-api-access-9mppl\") pod \"2d020083-cc7b-4359-b493-739ba052d397\" (UID: \"2d020083-cc7b-4359-b493-739ba052d397\") "
Jul 07 18:58:05.421502 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.421480    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d020083-cc7b-4359-b493-739ba052d397-kube-api-access-9mppl" (OuterVolumeSpecName: "kube-api-access-9mppl") pod "2d020083-cc7b-4359-b493-739ba052d397" (UID: "2d020083-cc7b-4359-b493-739ba052d397"). InnerVolumeSpecName "kube-api-access-9mppl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:05.520034 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:05.520007    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mppl\" (UniqueName: \"kubernetes.io/projected/2d020083-cc7b-4359-b493-739ba052d397-kube-api-access-9mppl\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 18:58:06.000466 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.000429    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d020083-cc7b-4359-b493-739ba052d397" containerID="eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33" exitCode=0
Jul 07 18:58:06.000466 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.000469    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8zbs7"
Jul 07 18:58:06.000950 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.000504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8zbs7" event={"ID":"2d020083-cc7b-4359-b493-739ba052d397","Type":"ContainerDied","Data":"eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33"}
Jul 07 18:58:06.000950 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.000540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8zbs7" event={"ID":"2d020083-cc7b-4359-b493-739ba052d397","Type":"ContainerDied","Data":"7559e44b36f6e97acc6076263c8b3cf332bac114b020fcd194491563a57cde3e"}
Jul 07 18:58:06.000950 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.000559    2577 scope.go:117] "RemoveContainer" containerID="eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33"
Jul 07 18:58:06.008504 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.008489    2577 scope.go:117] "RemoveContainer" containerID="eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33"
Jul 07 18:58:06.008736 ip-10-0-142-228 kubenswrapper[2577]: E0707 18:58:06.008717    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33\": container with ID starting with eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33 not found: ID does not exist" containerID="eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33"
Jul 07 18:58:06.008800 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.008748    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33"} err="failed to get container status \"eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33\": rpc error: code = NotFound desc = could not find container \"eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33\": container with ID starting with eb7d524316623d715eb4735e534ac172d35d7d49fa5f415a68eb8227533e2c33 not found: ID does not exist"
Jul 07 18:58:06.020951 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.020931    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8zbs7"]
Jul 07 18:58:06.027605 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:06.027585    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8zbs7"]
Jul 07 18:58:07.003672 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:07.003642    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d020083-cc7b-4359-b493-739ba052d397" path="/var/lib/kubelet/pods/2d020083-cc7b-4359-b493-739ba052d397/volumes"
Jul 07 18:58:07.004039 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:07.003929    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7f0a7cc-e0bc-457c-b389-322809c589c7" path="/var/lib/kubelet/pods/e7f0a7cc-e0bc-457c-b389-322809c589c7/volumes"
Jul 07 18:58:07.004102 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:07.004096    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed8d48ce-5728-4e31-9c7b-e0ee1500d557" path="/var/lib/kubelet/pods/ed8d48ce-5728-4e31-9c7b-e0ee1500d557/volumes"
Jul 07 18:58:09.430590 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:09.430555    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:09.577340 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:09.577308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:09.666955 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:09.666920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:12.604427 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:12.604388    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:12.752068 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:12.752029    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:19.283172 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:19.283137    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:40.153563 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:40.153533    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:43.993236 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:43.993199    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:44.576109 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:44.576078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:44.926719 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:44.926636    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:45.043860 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:45.043827    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:45.142784 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:45.142756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:55.028623 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:55.028590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:55.130745 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:55.130714    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:55.570929 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:55.570870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:55.668047 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:58:55.668011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:10.532781 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.530743    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"]
Jul 07 18:59:10.532781 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.531406    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d020083-cc7b-4359-b493-739ba052d397" containerName="authorino"
Jul 07 18:59:10.532781 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.531440    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d020083-cc7b-4359-b493-739ba052d397" containerName="authorino"
Jul 07 18:59:10.532781 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.531573    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d020083-cc7b-4359-b493-739ba052d397" containerName="authorino"
Jul 07 18:59:10.536112 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.536085    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.539920 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.539896    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 18:59:10.539920 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.539926    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hpqdr\""
Jul 07 18:59:10.540142 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.539950    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 18:59:10.540142 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.539994    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 18:59:10.544884 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.544861    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"]
Jul 07 18:59:10.567842 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.567816    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:10.673640 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.673619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.673749 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.673655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.673749 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.673675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.673749 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.673718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.673849 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.673779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45aa2a27-7848-4f45-a71c-b8231c746815-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.673849 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.673804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw9h6\" (UniqueName: \"kubernetes.io/projected/45aa2a27-7848-4f45-a71c-b8231c746815-kube-api-access-gw9h6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774380 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774512 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774512 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774512 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774512 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45aa2a27-7848-4f45-a71c-b8231c746815-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774732 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw9h6\" (UniqueName: \"kubernetes.io/projected/45aa2a27-7848-4f45-a71c-b8231c746815-kube-api-access-gw9h6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774784 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774765    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774835 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774816    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.774914 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.774891    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.776691 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.776664    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45aa2a27-7848-4f45-a71c-b8231c746815-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.776887 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.776867    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45aa2a27-7848-4f45-a71c-b8231c746815-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.783004 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.782949    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw9h6\" (UniqueName: \"kubernetes.io/projected/45aa2a27-7848-4f45-a71c-b8231c746815-kube-api-access-gw9h6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml\" (UID: \"45aa2a27-7848-4f45-a71c-b8231c746815\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.846810 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.846789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:10.984018 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:10.983923    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"]
Jul 07 18:59:10.986590 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:59:10.986559    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45aa2a27_7848_4f45_a71c_b8231c746815.slice/crio-2929626adb19e22eac3fbc1003d657193d5ba1e0bd4f4a2f8465ecd29fcc64c1 WatchSource:0}: Error finding container 2929626adb19e22eac3fbc1003d657193d5ba1e0bd4f4a2f8465ecd29fcc64c1: Status 404 returned error can't find the container with id 2929626adb19e22eac3fbc1003d657193d5ba1e0bd4f4a2f8465ecd29fcc64c1
Jul 07 18:59:11.252320 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:11.252274    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml" event={"ID":"45aa2a27-7848-4f45-a71c-b8231c746815","Type":"ContainerStarted","Data":"2929626adb19e22eac3fbc1003d657193d5ba1e0bd4f4a2f8465ecd29fcc64c1"}
Jul 07 18:59:12.257495 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:12.257461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml" event={"ID":"45aa2a27-7848-4f45-a71c-b8231c746815","Type":"ContainerStarted","Data":"1a7aad2bf34bbbbe0cd3c1f10dc90e921cd61f87a5c93df728c1a774f584e53e"}
Jul 07 18:59:12.276516 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:12.276470    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml" podStartSLOduration=1.217228345 podStartE2EDuration="2.276454627s" totalImagesPullingTime="1.059226282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:12.275800734 +0000 UTC m=+548.041908108" watchObservedRunningTime="2026-07-07 18:59:12.276454627 +0000 UTC m=+548.042561999"
Jul 07 18:59:20.847870 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:20.847834    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:20.848317 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:20.847894    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:20.860202 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:20.860174    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:21.302376 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:21.302343    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml"
Jul 07 18:59:21.691917 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:21.691838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:32.109828 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.109794    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"]
Jul 07 18:59:32.112774 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.112757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.115791 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.115767    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 18:59:32.124408 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.124387    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"]
Jul 07 18:59:32.144085 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.144062    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:32.239157 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.239115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/118bfab6-8c8b-4836-bef9-de11feb55185-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.239285 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.239177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.239285 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.239204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.239285 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.239229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.239386 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.239308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.239386 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.239369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb92v\" (UniqueName: \"kubernetes.io/projected/118bfab6-8c8b-4836-bef9-de11feb55185-kube-api-access-xb92v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.340524 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.340497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/118bfab6-8c8b-4836-bef9-de11feb55185-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.340679 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.340536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.340679 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.340559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.340679 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.340584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.340679 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.340631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.340679 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.340674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb92v\" (UniqueName: \"kubernetes.io/projected/118bfab6-8c8b-4836-bef9-de11feb55185-kube-api-access-xb92v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.340953 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.340928    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.341012 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.340993    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.341060 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.341042    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.343011 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.342988    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/118bfab6-8c8b-4836-bef9-de11feb55185-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.343510 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.343490    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/118bfab6-8c8b-4836-bef9-de11feb55185-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.349946 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.349928    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb92v\" (UniqueName: \"kubernetes.io/projected/118bfab6-8c8b-4836-bef9-de11feb55185-kube-api-access-xb92v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rt24d\" (UID: \"118bfab6-8c8b-4836-bef9-de11feb55185\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.422879 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.422823    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:32.551136 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:32.551111    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"]
Jul 07 18:59:32.552977 ip-10-0-142-228 kubenswrapper[2577]: W0707 18:59:32.552950    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118bfab6_8c8b_4836_bef9_de11feb55185.slice/crio-8cdcb1681b11d84e073998f7a09897e66a538cafb5ccda54a8930612327f30d8 WatchSource:0}: Error finding container 8cdcb1681b11d84e073998f7a09897e66a538cafb5ccda54a8930612327f30d8: Status 404 returned error can't find the container with id 8cdcb1681b11d84e073998f7a09897e66a538cafb5ccda54a8930612327f30d8
Jul 07 18:59:33.336915 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:33.336876    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d" event={"ID":"118bfab6-8c8b-4836-bef9-de11feb55185","Type":"ContainerStarted","Data":"a4865ab7d039f1616835931b856c906586e557f44d32091cdf98b91af62d4446"}
Jul 07 18:59:33.337284 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:33.336929    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d" event={"ID":"118bfab6-8c8b-4836-bef9-de11feb55185","Type":"ContainerStarted","Data":"8cdcb1681b11d84e073998f7a09897e66a538cafb5ccda54a8930612327f30d8"}
Jul 07 18:59:33.358662 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:33.358619    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d" podStartSLOduration=1.155516599 podStartE2EDuration="1.358602366s" totalImagesPullingTime="203.085767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:33.357838118 +0000 UTC m=+569.123945492" watchObservedRunningTime="2026-07-07 18:59:33.358602366 +0000 UTC m=+569.124709760"
Jul 07 18:59:39.737543 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:39.737496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:42.423052 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:42.423019    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:42.423466 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:42.423090    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:42.436119 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:42.436086    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:43.386208 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:43.386177    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rt24d"
Jul 07 18:59:43.709845 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:43.709772    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:53.599177 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.599148    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"]
Jul 07 18:59:53.602325 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.602307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.605180 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.605161    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 18:59:53.614437 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.614398    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"]
Jul 07 18:59:53.632095 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.632067    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:53.709052 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.709031    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7z74\" (UniqueName: \"kubernetes.io/projected/f391e443-3698-44a8-bde8-c48ab09e3c94-kube-api-access-v7z74\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.709148 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.709064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f391e443-3698-44a8-bde8-c48ab09e3c94-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.709148 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.709092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.709218 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.709159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.709218 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.709202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.709279 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.709233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.810556 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.810518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7z74\" (UniqueName: \"kubernetes.io/projected/f391e443-3698-44a8-bde8-c48ab09e3c94-kube-api-access-v7z74\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.810556 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.810558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f391e443-3698-44a8-bde8-c48ab09e3c94-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.810800 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.810581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.810800 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.810708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.810800 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.810759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.810951 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.810805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.810951 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.810935    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.811038 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.811016    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.811157 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.811137    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.813003 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.812976    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f391e443-3698-44a8-bde8-c48ab09e3c94-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.813089 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.813018    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f391e443-3698-44a8-bde8-c48ab09e3c94-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.820162 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.820133    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7z74\" (UniqueName: \"kubernetes.io/projected/f391e443-3698-44a8-bde8-c48ab09e3c94-kube-api-access-v7z74\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2\" (UID: \"f391e443-3698-44a8-bde8-c48ab09e3c94\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:53.911824 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:53.911756    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 18:59:54.035105 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:54.035082    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"]
Jul 07 18:59:54.420090 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:54.420054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2" event={"ID":"f391e443-3698-44a8-bde8-c48ab09e3c94","Type":"ContainerStarted","Data":"d76b21f46500b8f6a03918c9d1c79bafa5759826eaf1279683624373fdefe299"}
Jul 07 18:59:54.420275 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:54.420103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2" event={"ID":"f391e443-3698-44a8-bde8-c48ab09e3c94","Type":"ContainerStarted","Data":"8bfae1f5dd218472f2a591a1f05794da5e9fd8a4e3d13bfa829abdb987b60db8"}
Jul 07 18:59:54.440091 ip-10-0-142-228 kubenswrapper[2577]: I0707 18:59:54.440046    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2" podStartSLOduration=1.283571925 podStartE2EDuration="1.440032701s" totalImagesPullingTime="156.460776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:54.438809309 +0000 UTC m=+590.204916694" watchObservedRunningTime="2026-07-07 18:59:54.440032701 +0000 UTC m=+590.206140074"
Jul 07 19:00:03.912662 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:03.912621    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 19:00:03.913110 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:03.912678    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 19:00:03.925154 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:03.925121    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 19:00:04.468959 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:04.468931    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2"
Jul 07 19:00:04.774205 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:04.774179    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:00:04.775786 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:04.775764    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:00:12.247794 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:12.247757    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:00:29.458832 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:29.458755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:00:29.559813 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:00:29.559786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:01:03.902967 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:03.902932    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5df569699c-wk2qb"]
Jul 07 19:01:03.905354 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:03.905334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5df569699c-wk2qb"
Jul 07 19:01:03.914029 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:03.914006    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5df569699c-wk2qb"]
Jul 07 19:01:03.935303 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:03.935277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/041fd0df-8137-4f3a-b5f9-e23388c11d1c-tls-cert\") pod \"authorino-5df569699c-wk2qb\" (UID: \"041fd0df-8137-4f3a-b5f9-e23388c11d1c\") " pod="kuadrant-system/authorino-5df569699c-wk2qb"
Jul 07 19:01:03.935440 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:03.935310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvskx\" (UniqueName: \"kubernetes.io/projected/041fd0df-8137-4f3a-b5f9-e23388c11d1c-kube-api-access-rvskx\") pod \"authorino-5df569699c-wk2qb\" (UID: \"041fd0df-8137-4f3a-b5f9-e23388c11d1c\") " pod="kuadrant-system/authorino-5df569699c-wk2qb"
Jul 07 19:01:04.035875 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.035839    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvskx\" (UniqueName: \"kubernetes.io/projected/041fd0df-8137-4f3a-b5f9-e23388c11d1c-kube-api-access-rvskx\") pod \"authorino-5df569699c-wk2qb\" (UID: \"041fd0df-8137-4f3a-b5f9-e23388c11d1c\") " pod="kuadrant-system/authorino-5df569699c-wk2qb"
Jul 07 19:01:04.036021 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.035932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/041fd0df-8137-4f3a-b5f9-e23388c11d1c-tls-cert\") pod \"authorino-5df569699c-wk2qb\" (UID: \"041fd0df-8137-4f3a-b5f9-e23388c11d1c\") " pod="kuadrant-system/authorino-5df569699c-wk2qb"
Jul 07 19:01:04.038292 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.038268    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/041fd0df-8137-4f3a-b5f9-e23388c11d1c-tls-cert\") pod \"authorino-5df569699c-wk2qb\" (UID: \"041fd0df-8137-4f3a-b5f9-e23388c11d1c\") " pod="kuadrant-system/authorino-5df569699c-wk2qb"
Jul 07 19:01:04.045385 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.045364    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvskx\" (UniqueName: \"kubernetes.io/projected/041fd0df-8137-4f3a-b5f9-e23388c11d1c-kube-api-access-rvskx\") pod \"authorino-5df569699c-wk2qb\" (UID: \"041fd0df-8137-4f3a-b5f9-e23388c11d1c\") " pod="kuadrant-system/authorino-5df569699c-wk2qb"
Jul 07 19:01:04.214179 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.214113    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5df569699c-wk2qb"
Jul 07 19:01:04.346129 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.346099    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5df569699c-wk2qb"]
Jul 07 19:01:04.349630 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:01:04.349603    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod041fd0df_8137_4f3a_b5f9_e23388c11d1c.slice/crio-b985816afffe41d8a344f2d1067194423fb6373ff57fccd4fbf67482bad51e83 WatchSource:0}: Error finding container b985816afffe41d8a344f2d1067194423fb6373ff57fccd4fbf67482bad51e83: Status 404 returned error can't find the container with id b985816afffe41d8a344f2d1067194423fb6373ff57fccd4fbf67482bad51e83
Jul 07 19:01:04.363950 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.363924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:01:04.462844 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.462806    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:01:04.693224 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:04.693191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5df569699c-wk2qb" event={"ID":"041fd0df-8137-4f3a-b5f9-e23388c11d1c","Type":"ContainerStarted","Data":"b985816afffe41d8a344f2d1067194423fb6373ff57fccd4fbf67482bad51e83"}
Jul 07 19:01:05.647432 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:05.647374    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:01:05.699725 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:05.699683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5df569699c-wk2qb" event={"ID":"041fd0df-8137-4f3a-b5f9-e23388c11d1c","Type":"ContainerStarted","Data":"0d754e9947e1e7ac64499bea8c1506f256eeaa6214d70f4b2fd00c317649ceac"}
Jul 07 19:01:05.719623 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:05.719562    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5df569699c-wk2qb" podStartSLOduration=2.248230511 podStartE2EDuration="2.719541967s" totalImagesPullingTime="471.311456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:05.718403007 +0000 UTC m=+661.484510381" watchObservedRunningTime="2026-07-07 19:01:05.719541967 +0000 UTC m=+661.485649342"
Jul 07 19:01:05.730752 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:05.730705    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:01:05.754675 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:05.754631    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-685fc465b4-shfkd"]
Jul 07 19:01:05.755128 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:05.755098    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-685fc465b4-shfkd" podUID="fa041ea6-d659-4f2f-a356-5d0ec171623a" containerName="authorino" containerID="cri-o://fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed" gracePeriod=30
Jul 07 19:01:05.995672 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:05.995646    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 19:01:06.055792 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.055761    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vl6v\" (UniqueName: \"kubernetes.io/projected/fa041ea6-d659-4f2f-a356-5d0ec171623a-kube-api-access-5vl6v\") pod \"fa041ea6-d659-4f2f-a356-5d0ec171623a\" (UID: \"fa041ea6-d659-4f2f-a356-5d0ec171623a\") "
Jul 07 19:01:06.055950 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.055799    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa041ea6-d659-4f2f-a356-5d0ec171623a-tls-cert\") pod \"fa041ea6-d659-4f2f-a356-5d0ec171623a\" (UID: \"fa041ea6-d659-4f2f-a356-5d0ec171623a\") "
Jul 07 19:01:06.058039 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.058000    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa041ea6-d659-4f2f-a356-5d0ec171623a-kube-api-access-5vl6v" (OuterVolumeSpecName: "kube-api-access-5vl6v") pod "fa041ea6-d659-4f2f-a356-5d0ec171623a" (UID: "fa041ea6-d659-4f2f-a356-5d0ec171623a"). InnerVolumeSpecName "kube-api-access-5vl6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:01:06.065282 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.065252    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa041ea6-d659-4f2f-a356-5d0ec171623a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fa041ea6-d659-4f2f-a356-5d0ec171623a" (UID: "fa041ea6-d659-4f2f-a356-5d0ec171623a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:01:06.157381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.157326    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vl6v\" (UniqueName: \"kubernetes.io/projected/fa041ea6-d659-4f2f-a356-5d0ec171623a-kube-api-access-5vl6v\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:01:06.157381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.157382    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa041ea6-d659-4f2f-a356-5d0ec171623a-tls-cert\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:01:06.706778 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.706738    2577 generic.go:356] "Generic (PLEG): container finished" podID="fa041ea6-d659-4f2f-a356-5d0ec171623a" containerID="fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed" exitCode=0
Jul 07 19:01:06.707234 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.706801    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685fc465b4-shfkd"
Jul 07 19:01:06.707234 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.706815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685fc465b4-shfkd" event={"ID":"fa041ea6-d659-4f2f-a356-5d0ec171623a","Type":"ContainerDied","Data":"fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed"}
Jul 07 19:01:06.707234 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.706860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685fc465b4-shfkd" event={"ID":"fa041ea6-d659-4f2f-a356-5d0ec171623a","Type":"ContainerDied","Data":"a4864fec25f0299500c9726cb9a19ebd58104d2de18f688be47d6fc592a347e2"}
Jul 07 19:01:06.707234 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.706883    2577 scope.go:117] "RemoveContainer" containerID="fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed"
Jul 07 19:01:06.715180 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.715157    2577 scope.go:117] "RemoveContainer" containerID="fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed"
Jul 07 19:01:06.715463 ip-10-0-142-228 kubenswrapper[2577]: E0707 19:01:06.715442    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed\": container with ID starting with fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed not found: ID does not exist" containerID="fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed"
Jul 07 19:01:06.715540 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.715473    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed"} err="failed to get container status \"fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed\": rpc error: code = NotFound desc = could not find container \"fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed\": container with ID starting with fb20b04a3359222a2490f4c51d03ee5bd1f916b91e97c2a118ba025d317f33ed not found: ID does not exist"
Jul 07 19:01:06.738596 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.738563    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-685fc465b4-shfkd"]
Jul 07 19:01:06.740854 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:06.740832    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-685fc465b4-shfkd"]
Jul 07 19:01:07.004550 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:01:07.004519    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa041ea6-d659-4f2f-a356-5d0ec171623a" path="/var/lib/kubelet/pods/fa041ea6-d659-4f2f-a356-5d0ec171623a/volumes"
Jul 07 19:02:18.450845 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:02:18.450810    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:02:19.903442 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:02:19.903395    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:02:20.524629 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:02:20.524593    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:02:44.454994 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:02:44.454953    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:02:44.605147 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:02:44.605111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:02:59.800873 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:02:59.800840    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:02:59.901584 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:02:59.901554    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:03:00.074659 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:03:00.074572    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:03:06.510776 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:03:06.510734    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:03:06.620450 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:03:06.620398    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:03:06.712161 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:03:06.712117    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:03:06.914076 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:03:06.914003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:03:13.005811 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:03:13.005778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:03:13.108148 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:03:13.108100    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:03:53.900509 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:03:53.900472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:05:04.797023 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:05:04.796946    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:05:04.802787 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:05:04.802758    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:06:25.621765 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:06:25.621732    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:07:28.211093 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:07:28.211058    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:04.828574 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:10:04.828543    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:10:04.829108 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:10:04.828816    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:10:22.155083 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:10:22.155041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:52.602741 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:10:52.602711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:52.703297 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:10:52.703264    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:54.591775 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:13:54.591729    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:04.193689 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:04.193594    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:12.511854 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:12.511823    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:14.829220 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:14.829181    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:17.634522 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:17.634487    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:20.574820 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:20.574783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:20.674548 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:20.674515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:21.065458 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:21.065431    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:27.359248 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:27.359198    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:27.434803 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:27.434769    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:27.622651 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:27.622577    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:27.726310 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:27.726280    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:28.789312 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:28.789282    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:28.885126 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:28.885096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:28.978982 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:28.978945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:29.092484 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:29.092382    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:29.345722 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:29.345599    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:29.449713 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:29.449678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:31.692799 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:31.692771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:33.876842 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:33.876814    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:34.118222 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:34.118188    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:34.267168 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:34.267140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:34.414918 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:34.414869    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:35.666193 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:35.666168    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:41.289615 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:41.289581    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:41.392595 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:41.392560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:41.891331 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:41.891298    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:41.991288 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:41.991256    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:42.126787 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:42.126753    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:42.226053 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:42.225973    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:42.603681 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:42.603644    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:42.703737 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:42.703704    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:44.328943 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:44.328912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:46.112822 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:46.112785    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:46.945562 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:46.945518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:47.340834 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:47.340807    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:53.036707 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:53.036672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:53.137432 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:53.137379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:55.340127 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:55.340096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:59.385769 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:59.385736    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:59.485633 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:59.485600    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:59.586508 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:59.586471    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:59.689813 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:14:59.689733    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:00.771873 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:00.771840    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:00.871029 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:00.870999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:00.955521 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:00.955488    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:01.367185 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:01.367154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:01.548146 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:01.548115    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:03.050740 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:03.050707    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:04.850970 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:04.850947    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:15:04.851991 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:04.851976    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:15:05.138011 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:05.137921    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:05.325565 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:05.325537    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:05.426189 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:05.426111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:05.549003 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:05.548964    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:07.374347 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:07.374319    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:12.756199 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:12.756164    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:12.910429 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:12.910373    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:13.273036 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:13.272999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:13.388945 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:13.388914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:14.926253 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:14.926216    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:21.263856 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:21.263825    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:21.363306 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:21.363266    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:21.464953 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:21.464924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:21.563602 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:21.563529    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:22.025917 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:22.025888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:47.999865 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:47.999826    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:54.458669 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:54.458639    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:54.566541 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:54.566511    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:54.667011 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:15:54.666980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:10.575586 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:10.575555    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:16.670536 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:16.670505    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:16.772163 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:16.772132    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:16.873270 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:16.873239    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:27.400692 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:27.400658    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:28.168321 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:28.168287    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:34.305867 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:34.305831    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:34.413114 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:34.413053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:34.507294 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:34.507223    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:34.609880 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:34.609792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:35.381202 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:35.381166    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:35.480704 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:35.480670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:35.586765 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:35.586736    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:37.203565 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:37.203536    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:43.889641 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:43.889604    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:43.992821 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:43.992794    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:44.627479 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:44.627443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:50.828670 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:50.828637    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:50.930454 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:50.930427    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:51.068242 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:51.068215    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:51.385343 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:51.385302    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:51.645883 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:51.645805    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:54.290920 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:54.290889    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:54.396024 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:54.395991    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:54.519543 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:54.519499    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:54.623138 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:54.623059    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:55.069845 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:55.069810    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:55.168092 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:55.168066    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:58.739158 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:58.739078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:59.475462 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:59.475403    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:59.566254 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:59.566227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:59.924276 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:16:59.924245    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:05.926279 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:05.926243    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:05.990126 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:05.990097    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:06.315613 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:06.315562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:06.699333 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:06.699253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:06.799787 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:06.799758    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:13.295171 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:13.295140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:13.396742 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:13.396716    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:13.554713 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:13.554631    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:13.768192 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:13.768154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:13.895822 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:13.895739    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:13.995034 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:13.995000    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:14.106269 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:14.106243    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:20.269393 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:20.269354    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:20.395772 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:20.395740    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:20.510923 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:20.510888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:20.636762 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:20.636673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:24.424697 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:24.424657    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:27.095757 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:27.095725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:27.217834 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:27.217792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:33.987907 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:33.987872    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:34.308643 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:34.308583    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:34.416958 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:34.416925    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:37.490375 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:37.490333    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:37.582873 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:37.582838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:37.770946 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:37.770910    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:37.980891 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:37.980856    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:38.397920 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:38.397884    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:38.502811 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:38.502774    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:40.915000 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:40.914964    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:41.011223 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:41.011195    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:42.027015 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:42.026978    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:50.222339 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.222307    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"]
Jul 07 19:17:50.222729 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.222597    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa041ea6-d659-4f2f-a356-5d0ec171623a" containerName="authorino"
Jul 07 19:17:50.222729 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.222609    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa041ea6-d659-4f2f-a356-5d0ec171623a" containerName="authorino"
Jul 07 19:17:50.222729 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.222669    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa041ea6-d659-4f2f-a356-5d0ec171623a" containerName="authorino"
Jul 07 19:17:50.225292 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.225276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.229860 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.229837    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-fec6862b\"/\"kube-root-ca.crt\""
Jul 07 19:17:50.231281 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.231259    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-fec6862b\"/\"e2e-lifecycle-model-fec6862b-kserve-self-signed-certs\""
Jul 07 19:17:50.231453 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.231291    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-fec6862b\"/\"default-dockercfg-sdz2r\""
Jul 07 19:17:50.231559 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.231336    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-fec6862b\"/\"openshift-service-ca.crt\""
Jul 07 19:17:50.238993 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.238970    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"]
Jul 07 19:17:50.266508 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.266483    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:50.268440 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.268405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-home\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.268527 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.268453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tls-certs\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.268527 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.268475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tmp-dir\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.268527 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.268502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-dshm\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.268632 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.268521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddmd2\" (UniqueName: \"kubernetes.io/projected/7815f8ae-37a8-4a75-b0f0-cf34292ad119-kube-api-access-ddmd2\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.268632 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.268561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-model-cache\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.368957 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.368934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-dshm\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.369050 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.368962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmd2\" (UniqueName: \"kubernetes.io/projected/7815f8ae-37a8-4a75-b0f0-cf34292ad119-kube-api-access-ddmd2\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.369050 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.368995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-model-cache\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.369050 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.369038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-home\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.369163 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.369069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tls-certs\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.369163 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.369108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tmp-dir\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.369458 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.369432    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-model-cache\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.369538 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.369495    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tmp-dir\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.369589 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.369534    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-home\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.371285 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.371263    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-dshm\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.371498 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.371483    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tls-certs\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.380085 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.380064    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddmd2\" (UniqueName: \"kubernetes.io/projected/7815f8ae-37a8-4a75-b0f0-cf34292ad119-kube-api-access-ddmd2\") pod \"e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") " pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.534927 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.534901    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:17:50.665908 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:50.665882    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"]
Jul 07 19:17:50.668251 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:17:50.668226    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7815f8ae_37a8_4a75_b0f0_cf34292ad119.slice/crio-44e80b0caba6d759d1aa4e2468da1ba0c07d174f548273991dba52c1297135b6 WatchSource:0}: Error finding container 44e80b0caba6d759d1aa4e2468da1ba0c07d174f548273991dba52c1297135b6: Status 404 returned error can't find the container with id 44e80b0caba6d759d1aa4e2468da1ba0c07d174f548273991dba52c1297135b6
Jul 07 19:17:51.648477 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:51.648442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6" event={"ID":"7815f8ae-37a8-4a75-b0f0-cf34292ad119","Type":"ContainerStarted","Data":"cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031"}
Jul 07 19:17:51.648922 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:51.648488    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6" event={"ID":"7815f8ae-37a8-4a75-b0f0-cf34292ad119","Type":"ContainerStarted","Data":"44e80b0caba6d759d1aa4e2468da1ba0c07d174f548273991dba52c1297135b6"}
Jul 07 19:17:59.268056 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:59.268022    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:59.384389 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:17:59.384357    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:00.535137 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:00.535102    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:18:00.535522 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:00.535148    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:18:00.547315 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:00.547292    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:18:00.576940 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:00.576903    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6" podStartSLOduration=10.576891033 podStartE2EDuration="10.576891033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:17:51.695092685 +0000 UTC m=+1667.461200057" watchObservedRunningTime="2026-07-07 19:18:00.576891033 +0000 UTC m=+1676.342998406"
Jul 07 19:18:00.695652 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:00.695630    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:18:06.009623 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:06.009588    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:06.109626 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:06.109594    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:09.887262 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:09.887230    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:10.396618 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:10.396578    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:16.033835 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:16.033793    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:21.113868 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:21.113834    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"]
Jul 07 19:18:21.208715 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:21.208680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:36.133598 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.133531    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6" podUID="7815f8ae-37a8-4a75-b0f0-cf34292ad119" containerName="main" containerID="cri-o://cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031" gracePeriod=45
Jul 07 19:18:36.372429 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.372397    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:18:36.525166 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525135    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tls-certs\") pod \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") "
Jul 07 19:18:36.525343 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525189    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-model-cache\") pod \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") "
Jul 07 19:18:36.525343 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tmp-dir\") pod \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") "
Jul 07 19:18:36.525343 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525248    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-dshm\") pod \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") "
Jul 07 19:18:36.525343 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525289    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddmd2\" (UniqueName: \"kubernetes.io/projected/7815f8ae-37a8-4a75-b0f0-cf34292ad119-kube-api-access-ddmd2\") pod \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") "
Jul 07 19:18:36.525343 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525335    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-home\") pod \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\" (UID: \"7815f8ae-37a8-4a75-b0f0-cf34292ad119\") "
Jul 07 19:18:36.525626 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525483    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-model-cache" (OuterVolumeSpecName: "model-cache") pod "7815f8ae-37a8-4a75-b0f0-cf34292ad119" (UID: "7815f8ae-37a8-4a75-b0f0-cf34292ad119"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:36.525626 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525531    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7815f8ae-37a8-4a75-b0f0-cf34292ad119" (UID: "7815f8ae-37a8-4a75-b0f0-cf34292ad119"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:36.525726 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525647    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:18:36.525726 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525674    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:18:36.525726 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.525641    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-home" (OuterVolumeSpecName: "home") pod "7815f8ae-37a8-4a75-b0f0-cf34292ad119" (UID: "7815f8ae-37a8-4a75-b0f0-cf34292ad119"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:36.527400 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.527370    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-dshm" (OuterVolumeSpecName: "dshm") pod "7815f8ae-37a8-4a75-b0f0-cf34292ad119" (UID: "7815f8ae-37a8-4a75-b0f0-cf34292ad119"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:36.527532 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.527475    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7815f8ae-37a8-4a75-b0f0-cf34292ad119-kube-api-access-ddmd2" (OuterVolumeSpecName: "kube-api-access-ddmd2") pod "7815f8ae-37a8-4a75-b0f0-cf34292ad119" (UID: "7815f8ae-37a8-4a75-b0f0-cf34292ad119"). InnerVolumeSpecName "kube-api-access-ddmd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:36.527580 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.527561    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7815f8ae-37a8-4a75-b0f0-cf34292ad119" (UID: "7815f8ae-37a8-4a75-b0f0-cf34292ad119"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:18:36.626677 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.626656    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:18:36.626677 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.626678    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddmd2\" (UniqueName: \"kubernetes.io/projected/7815f8ae-37a8-4a75-b0f0-cf34292ad119-kube-api-access-ddmd2\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:18:36.626808 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.626688    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7815f8ae-37a8-4a75-b0f0-cf34292ad119-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:18:36.626808 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.626696    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7815f8ae-37a8-4a75-b0f0-cf34292ad119-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:18:36.828798 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.828719    2577 generic.go:356] "Generic (PLEG): container finished" podID="7815f8ae-37a8-4a75-b0f0-cf34292ad119" containerID="cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031" exitCode=0
Jul 07 19:18:36.828798 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.828763    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"
Jul 07 19:18:36.828798 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.828764    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6" event={"ID":"7815f8ae-37a8-4a75-b0f0-cf34292ad119","Type":"ContainerDied","Data":"cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031"}
Jul 07 19:18:36.829009 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.828804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6" event={"ID":"7815f8ae-37a8-4a75-b0f0-cf34292ad119","Type":"ContainerDied","Data":"44e80b0caba6d759d1aa4e2468da1ba0c07d174f548273991dba52c1297135b6"}
Jul 07 19:18:36.829009 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.828825    2577 scope.go:117] "RemoveContainer" containerID="cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031"
Jul 07 19:18:36.837736 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.837714    2577 scope.go:117] "RemoveContainer" containerID="cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031"
Jul 07 19:18:36.837996 ip-10-0-142-228 kubenswrapper[2577]: E0707 19:18:36.837975    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031\": container with ID starting with cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031 not found: ID does not exist" containerID="cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031"
Jul 07 19:18:36.838073 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.838008    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031"} err="failed to get container status \"cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031\": rpc error: code = NotFound desc = could not find container \"cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031\": container with ID starting with cd0936dc9eaf9ca4be11b5fd607660c8fda5bc4c34b00bd94f70cbe623f96031 not found: ID does not exist"
Jul 07 19:18:36.852549 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.852526    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"]
Jul 07 19:18:36.856395 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:36.856376    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-fec6862b/e2e-lifecycle-model-fec6862b-kserve-77699b447-vqvj6"]
Jul 07 19:18:37.004191 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:37.004165    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7815f8ae-37a8-4a75-b0f0-cf34292ad119" path="/var/lib/kubelet/pods/7815f8ae-37a8-4a75-b0f0-cf34292ad119/volumes"
Jul 07 19:18:57.533014 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:57.532965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:58.825648 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:18:58.825616    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:05.294760 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:05.294703    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:05.356429 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:05.356383    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:05.580903 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:05.580812    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:05.852000 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:05.851927    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:06.890141 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:06.890107    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:06.984995 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:06.984964    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:07.087802 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:07.087755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:07.800196 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:07.800143    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:07.902011 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:07.901974    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:08.005599 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:08.005568    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:09.379342 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:09.379313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:15.571244 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:15.571211    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:15.671604 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:15.671569    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:16.270239 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:16.270196    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:22.537778 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:22.537744    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:22.630840 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:22.630802    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:22.729269 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:22.729233    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:33.211433 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:33.211323    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:33.540314 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:33.540282    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:54.524224 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:19:54.524154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:01.011254 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:01.011164    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:01.090158 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:01.090127    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:01.356581 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:01.356491    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:01.813798 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:01.813747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:02.171783 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:02.171759    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:04.268789 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:04.268752    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:04.367146 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:04.367104    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:04.483312 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:04.483275    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:04.705215 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:04.705125    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:04.878377 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:04.878351    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:20:04.880224 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:04.880199    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:20:04.938336 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:04.938304    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:05.037291 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:05.037266    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:08.724069 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:08.724034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:09.067941 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:09.067908    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:09.418774 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:09.418694    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:10.182468 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:10.182435    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:12.253578 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:12.253538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:12.345257 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:12.345224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:12.474190 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:12.474156    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:12.565649 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:12.565573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:12.859899 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:12.859819    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:12.960291 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:12.960250    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:16.740959 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:16.740922    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:19.905385 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.905356    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"]
Jul 07 19:20:19.905777 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.905645    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7815f8ae-37a8-4a75-b0f0-cf34292ad119" containerName="main"
Jul 07 19:20:19.905777 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.905657    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7815f8ae-37a8-4a75-b0f0-cf34292ad119" containerName="main"
Jul 07 19:20:19.905777 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.905707    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7815f8ae-37a8-4a75-b0f0-cf34292ad119" containerName="main"
Jul 07 19:20:19.908423 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.908398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:19.911247 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.911224    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4e0129\"/\"default-dockercfg-w5q62\""
Jul 07 19:20:19.911247 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.911243    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4e0129\"/\"kube-root-ca.crt\""
Jul 07 19:20:19.912474 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.912405    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4e0129\"/\"test-model-4e0129-kserve-self-signed-certs\""
Jul 07 19:20:19.912474 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.912459    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4e0129\"/\"openshift-service-ca.crt\""
Jul 07 19:20:19.919616 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.919598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"]
Jul 07 19:20:19.933593 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:19.933566    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:20.067494 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.067465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-tmp-dir\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.067614 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.067497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt579\" (UniqueName: \"kubernetes.io/projected/77b8403c-c789-4079-90e9-7028e4a1f374-kube-api-access-tt579\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.067614 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.067580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-home\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.067614 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.067608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-model-cache\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.067774 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.067660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b8403c-c789-4079-90e9-7028e4a1f374-tls-certs\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.067774 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.067707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-dshm\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168368 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-home\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168368 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-model-cache\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168517 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b8403c-c789-4079-90e9-7028e4a1f374-tls-certs\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168517 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-dshm\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168517 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-tmp-dir\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168517 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt579\" (UniqueName: \"kubernetes.io/projected/77b8403c-c789-4079-90e9-7028e4a1f374-kube-api-access-tt579\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168764 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168743    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-home\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168835 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168797    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-model-cache\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.168907 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.168889    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-tmp-dir\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.170554 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.170534    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-dshm\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.170801 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.170783    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b8403c-c789-4079-90e9-7028e4a1f374-tls-certs\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.178315 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.178294    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt579\" (UniqueName: \"kubernetes.io/projected/77b8403c-c789-4079-90e9-7028e4a1f374-kube-api-access-tt579\") pod \"test-model-4e0129-kserve-7bb9445987-s29tk\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") " pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.217491 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.217470    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:20.345376 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:20.345318    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"]
Jul 07 19:20:20.347592 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:20:20.347559    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77b8403c_c789_4079_90e9_7028e4a1f374.slice/crio-3462057e7b17a62af1c29073497c34e6ef7cb67471f38f720bc4a6d9d728b66e WatchSource:0}: Error finding container 3462057e7b17a62af1c29073497c34e6ef7cb67471f38f720bc4a6d9d728b66e: Status 404 returned error can't find the container with id 3462057e7b17a62af1c29073497c34e6ef7cb67471f38f720bc4a6d9d728b66e
Jul 07 19:20:21.242299 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:21.242270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk" event={"ID":"77b8403c-c789-4079-90e9-7028e4a1f374","Type":"ContainerStarted","Data":"ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2"}
Jul 07 19:20:21.242680 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:21.242304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk" event={"ID":"77b8403c-c789-4079-90e9-7028e4a1f374","Type":"ContainerStarted","Data":"3462057e7b17a62af1c29073497c34e6ef7cb67471f38f720bc4a6d9d728b66e"}
Jul 07 19:20:21.264602 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:21.264562    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk" podStartSLOduration=2.264548798 podStartE2EDuration="2.264548798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:20:21.263644763 +0000 UTC m=+1817.029752139" watchObservedRunningTime="2026-07-07 19:20:21.264548798 +0000 UTC m=+1817.030656172"
Jul 07 19:20:25.677637 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:25.677600    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:25.780630 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:25.780599    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:30.218347 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:30.218315    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:30.218751 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:30.218362    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:30.231795 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:30.231766    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:30.289168 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:30.289137    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:20:33.601102 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:33.601057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:33.706039 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:33.706006    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:38.919740 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:38.919709    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"]
Jul 07 19:20:38.922676 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:38.922660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:38.926938 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:38.926911    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2e4d95\"/\"openshift-service-ca.crt\""
Jul 07 19:20:38.926938 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:38.926927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2e4d95\"/\"test-model-2e4d95-kserve-self-signed-certs\""
Jul 07 19:20:38.927115 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:38.926926    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2e4d95\"/\"kube-root-ca.crt\""
Jul 07 19:20:38.927115 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:38.926918    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2e4d95\"/\"default-dockercfg-jc7gp\""
Jul 07 19:20:38.932341 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:38.932319    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"]
Jul 07 19:20:39.010401 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.010376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9284e36-01d3-42e1-8326-9573907eed03-tls-certs\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.010532 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.010407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-model-cache\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.010532 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.010486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-home\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.010532 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.010521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-dshm\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.010636 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.010539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvj9q\" (UniqueName: \"kubernetes.io/projected/c9284e36-01d3-42e1-8326-9573907eed03-kube-api-access-gvj9q\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.010636 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.010569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-tmp-dir\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.023005 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.022983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:39.111611 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.111588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9284e36-01d3-42e1-8326-9573907eed03-tls-certs\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.111728 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.111617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-model-cache\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.111728 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.111644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-home\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.111728 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.111672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-dshm\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.111885 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.111780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvj9q\" (UniqueName: \"kubernetes.io/projected/c9284e36-01d3-42e1-8326-9573907eed03-kube-api-access-gvj9q\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.111885 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.111824    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-tmp-dir\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.112008 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.111990    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-home\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.112070 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.112043    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-model-cache\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.112213 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.112194    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-tmp-dir\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.113818 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.113800    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-dshm\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.114122 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.114102    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9284e36-01d3-42e1-8326-9573907eed03-tls-certs\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.122038 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.122017    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvj9q\" (UniqueName: \"kubernetes.io/projected/c9284e36-01d3-42e1-8326-9573907eed03-kube-api-access-gvj9q\") pod \"test-model-2e4d95-kserve-7d6d9b84c-dvxc8\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") " pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.232778 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.232718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:39.362966 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:39.362943    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"]
Jul 07 19:20:39.365204 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:20:39.365179    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9284e36_01d3_42e1_8326_9573907eed03.slice/crio-5a3c83e03ed50ddd943c2527e4016bb42ccf5a255dbdec81505a39960984583a WatchSource:0}: Error finding container 5a3c83e03ed50ddd943c2527e4016bb42ccf5a255dbdec81505a39960984583a: Status 404 returned error can't find the container with id 5a3c83e03ed50ddd943c2527e4016bb42ccf5a255dbdec81505a39960984583a
Jul 07 19:20:40.321042 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:40.320997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8" event={"ID":"c9284e36-01d3-42e1-8326-9573907eed03","Type":"ContainerStarted","Data":"78a8c284797ddc2fa5aff595ee0760050df54531c5cd574ef5e8160fe07f35a9"}
Jul 07 19:20:40.321042 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:40.321042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8" event={"ID":"c9284e36-01d3-42e1-8326-9573907eed03","Type":"ContainerStarted","Data":"5a3c83e03ed50ddd943c2527e4016bb42ccf5a255dbdec81505a39960984583a"}
Jul 07 19:20:40.343971 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:40.343921    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8" podStartSLOduration=2.3439070060000002 podStartE2EDuration="2.343907006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:20:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:20:40.342497911 +0000 UTC m=+1836.108605275" watchObservedRunningTime="2026-07-07 19:20:40.343907006 +0000 UTC m=+1836.110014376"
Jul 07 19:20:41.223961 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:41.223926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:20:49.233283 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:49.233250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:49.233723 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:49.233483    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:49.246280 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:49.246260    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:20:49.365899 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:20:49.365871    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:21:00.255788 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:00.255748    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:15.398388 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:15.398353    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"]
Jul 07 19:21:15.433652 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:15.433623    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:16.289689 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:16.289656    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"]
Jul 07 19:21:16.310540 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:16.310509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:16.489108 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:16.489067    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:16.857438 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:16.857383    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:17.050891 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:17.050863    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:17.218183 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:17.218110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:17.445466 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:17.445440    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:21.937696 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:21.937664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:30.417821 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.417723    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk" podUID="77b8403c-c789-4079-90e9-7028e4a1f374" containerName="main" containerID="cri-o://ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2" gracePeriod=45
Jul 07 19:21:30.661184 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.661160    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:21:30.822406 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822381    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-home\") pod \"77b8403c-c789-4079-90e9-7028e4a1f374\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") "
Jul 07 19:21:30.822566 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822444    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt579\" (UniqueName: \"kubernetes.io/projected/77b8403c-c789-4079-90e9-7028e4a1f374-kube-api-access-tt579\") pod \"77b8403c-c789-4079-90e9-7028e4a1f374\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") "
Jul 07 19:21:30.822566 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822466    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-tmp-dir\") pod \"77b8403c-c789-4079-90e9-7028e4a1f374\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") "
Jul 07 19:21:30.822566 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822495    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b8403c-c789-4079-90e9-7028e4a1f374-tls-certs\") pod \"77b8403c-c789-4079-90e9-7028e4a1f374\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") "
Jul 07 19:21:30.822566 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822512    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-dshm\") pod \"77b8403c-c789-4079-90e9-7028e4a1f374\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") "
Jul 07 19:21:30.822566 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822536    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-model-cache\") pod \"77b8403c-c789-4079-90e9-7028e4a1f374\" (UID: \"77b8403c-c789-4079-90e9-7028e4a1f374\") "
Jul 07 19:21:30.822822 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822666    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-home" (OuterVolumeSpecName: "home") pod "77b8403c-c789-4079-90e9-7028e4a1f374" (UID: "77b8403c-c789-4079-90e9-7028e4a1f374"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:30.822822 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822713    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "77b8403c-c789-4079-90e9-7028e4a1f374" (UID: "77b8403c-c789-4079-90e9-7028e4a1f374"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:30.822822 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822753    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:30.822955 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.822837    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-model-cache" (OuterVolumeSpecName: "model-cache") pod "77b8403c-c789-4079-90e9-7028e4a1f374" (UID: "77b8403c-c789-4079-90e9-7028e4a1f374"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:30.824688 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.824657    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b8403c-c789-4079-90e9-7028e4a1f374-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "77b8403c-c789-4079-90e9-7028e4a1f374" (UID: "77b8403c-c789-4079-90e9-7028e4a1f374"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:21:30.824807 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.824727    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b8403c-c789-4079-90e9-7028e4a1f374-kube-api-access-tt579" (OuterVolumeSpecName: "kube-api-access-tt579") pod "77b8403c-c789-4079-90e9-7028e4a1f374" (UID: "77b8403c-c789-4079-90e9-7028e4a1f374"). InnerVolumeSpecName "kube-api-access-tt579". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:21:30.824807 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.824758    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-dshm" (OuterVolumeSpecName: "dshm") pod "77b8403c-c789-4079-90e9-7028e4a1f374" (UID: "77b8403c-c789-4079-90e9-7028e4a1f374"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:30.923572 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.923551    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:30.923572 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.923570    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b8403c-c789-4079-90e9-7028e4a1f374-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:30.923695 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.923578    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:30.923695 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.923587    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b8403c-c789-4079-90e9-7028e4a1f374-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:30.923695 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:30.923595    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt579\" (UniqueName: \"kubernetes.io/projected/77b8403c-c789-4079-90e9-7028e4a1f374-kube-api-access-tt579\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:31.309153 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.309118    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8" podUID="c9284e36-01d3-42e1-8326-9573907eed03" containerName="main" containerID="cri-o://78a8c284797ddc2fa5aff595ee0760050df54531c5cd574ef5e8160fe07f35a9" gracePeriod=45
Jul 07 19:21:31.522456 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.522428    2577 generic.go:356] "Generic (PLEG): container finished" podID="77b8403c-c789-4079-90e9-7028e4a1f374" containerID="ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2" exitCode=0
Jul 07 19:21:31.522922 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.522468    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"
Jul 07 19:21:31.522922 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.522504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk" event={"ID":"77b8403c-c789-4079-90e9-7028e4a1f374","Type":"ContainerDied","Data":"ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2"}
Jul 07 19:21:31.522922 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.522550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk" event={"ID":"77b8403c-c789-4079-90e9-7028e4a1f374","Type":"ContainerDied","Data":"3462057e7b17a62af1c29073497c34e6ef7cb67471f38f720bc4a6d9d728b66e"}
Jul 07 19:21:31.522922 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.522573    2577 scope.go:117] "RemoveContainer" containerID="ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2"
Jul 07 19:21:31.524364 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.524339    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9284e36-01d3-42e1-8326-9573907eed03" containerID="78a8c284797ddc2fa5aff595ee0760050df54531c5cd574ef5e8160fe07f35a9" exitCode=0
Jul 07 19:21:31.524508 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.524433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8" event={"ID":"c9284e36-01d3-42e1-8326-9573907eed03","Type":"ContainerDied","Data":"78a8c284797ddc2fa5aff595ee0760050df54531c5cd574ef5e8160fe07f35a9"}
Jul 07 19:21:31.531665 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.531638    2577 scope.go:117] "RemoveContainer" containerID="ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2"
Jul 07 19:21:31.531921 ip-10-0-142-228 kubenswrapper[2577]: E0707 19:21:31.531904    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2\": container with ID starting with ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2 not found: ID does not exist" containerID="ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2"
Jul 07 19:21:31.531978 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.531929    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2"} err="failed to get container status \"ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2\": rpc error: code = NotFound desc = could not find container \"ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2\": container with ID starting with ff9b35a1a700a059fb6b4e6bb357de6925d3a4c237a4b5c0c0a4664d091bbcb2 not found: ID does not exist"
Jul 07 19:21:31.550775 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.550754    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"]
Jul 07 19:21:31.552302 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.552282    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4e0129/test-model-4e0129-kserve-7bb9445987-s29tk"]
Jul 07 19:21:31.555815 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.555800    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:21:31.728951 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.728874    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-tmp-dir\") pod \"c9284e36-01d3-42e1-8326-9573907eed03\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") "
Jul 07 19:21:31.728951 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.728931    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-model-cache\") pod \"c9284e36-01d3-42e1-8326-9573907eed03\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") "
Jul 07 19:21:31.728951 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.728952    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvj9q\" (UniqueName: \"kubernetes.io/projected/c9284e36-01d3-42e1-8326-9573907eed03-kube-api-access-gvj9q\") pod \"c9284e36-01d3-42e1-8326-9573907eed03\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") "
Jul 07 19:21:31.729234 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.728979    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9284e36-01d3-42e1-8326-9573907eed03-tls-certs\") pod \"c9284e36-01d3-42e1-8326-9573907eed03\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") "
Jul 07 19:21:31.729234 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.728995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-home\") pod \"c9284e36-01d3-42e1-8326-9573907eed03\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") "
Jul 07 19:21:31.729234 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.729030    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-dshm\") pod \"c9284e36-01d3-42e1-8326-9573907eed03\" (UID: \"c9284e36-01d3-42e1-8326-9573907eed03\") "
Jul 07 19:21:31.729234 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.729154    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c9284e36-01d3-42e1-8326-9573907eed03" (UID: "c9284e36-01d3-42e1-8326-9573907eed03"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:31.729448 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.729281    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:31.729448 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.729293    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-home" (OuterVolumeSpecName: "home") pod "c9284e36-01d3-42e1-8326-9573907eed03" (UID: "c9284e36-01d3-42e1-8326-9573907eed03"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:31.729448 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.729310    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-model-cache" (OuterVolumeSpecName: "model-cache") pod "c9284e36-01d3-42e1-8326-9573907eed03" (UID: "c9284e36-01d3-42e1-8326-9573907eed03"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:31.731282 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.731256    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-dshm" (OuterVolumeSpecName: "dshm") pod "c9284e36-01d3-42e1-8326-9573907eed03" (UID: "c9284e36-01d3-42e1-8326-9573907eed03"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:21:31.731282 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.731274    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9284e36-01d3-42e1-8326-9573907eed03-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c9284e36-01d3-42e1-8326-9573907eed03" (UID: "c9284e36-01d3-42e1-8326-9573907eed03"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:21:31.731442 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.731315    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9284e36-01d3-42e1-8326-9573907eed03-kube-api-access-gvj9q" (OuterVolumeSpecName: "kube-api-access-gvj9q") pod "c9284e36-01d3-42e1-8326-9573907eed03" (UID: "c9284e36-01d3-42e1-8326-9573907eed03"). InnerVolumeSpecName "kube-api-access-gvj9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:21:31.830027 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.830000    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:31.830027 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.830025    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvj9q\" (UniqueName: \"kubernetes.io/projected/c9284e36-01d3-42e1-8326-9573907eed03-kube-api-access-gvj9q\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:31.830027 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.830036    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9284e36-01d3-42e1-8326-9573907eed03-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:31.830242 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.830045    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:31.830242 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:31.830053    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9284e36-01d3-42e1-8326-9573907eed03-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:21:32.530900 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:32.530869    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"
Jul 07 19:21:32.531343 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:32.530875    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8" event={"ID":"c9284e36-01d3-42e1-8326-9573907eed03","Type":"ContainerDied","Data":"5a3c83e03ed50ddd943c2527e4016bb42ccf5a255dbdec81505a39960984583a"}
Jul 07 19:21:32.531343 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:32.531005    2577 scope.go:117] "RemoveContainer" containerID="78a8c284797ddc2fa5aff595ee0760050df54531c5cd574ef5e8160fe07f35a9"
Jul 07 19:21:32.554265 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:32.554244    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"]
Jul 07 19:21:32.558927 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:32.558907    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2e4d95/test-model-2e4d95-kserve-7d6d9b84c-dvxc8"]
Jul 07 19:21:33.008788 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:33.008757    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b8403c-c789-4079-90e9-7028e4a1f374" path="/var/lib/kubelet/pods/77b8403c-c789-4079-90e9-7028e4a1f374/volumes"
Jul 07 19:21:33.009138 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:33.009124    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9284e36-01d3-42e1-8326-9573907eed03" path="/var/lib/kubelet/pods/c9284e36-01d3-42e1-8326-9573907eed03/volumes"
Jul 07 19:21:59.375640 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:59.375589    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:59.635284 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:59.635197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:59.912218 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:21:59.912131    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:00.230375 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:00.230301    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:00.585314 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:00.585277    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:00.695389 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:00.695363    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:00.802349 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:00.802323    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:00.957552 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:00.957465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:06.981029 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:06.980990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:07.050452 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:07.050401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:07.271963 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:07.271933    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:07.521510 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:07.521476    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:07.848283 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:07.848249    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:08.236795 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:08.236704    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:08.512179 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:08.512149    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:10.943348 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:10.943318    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:11.092594 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:11.092563    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:11.230266 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:11.230189    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:11.416601 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:11.416568    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:11.698653 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:11.698624    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:11.794275 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:11.794246    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:15.439891 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:15.439858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:15.920824 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:15.920788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:16.280133 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:16.280101    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:16.635660 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:16.635570    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:19.188787 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:19.188752    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:19.323476 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:19.323382    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:19.508014 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:19.507981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:20.281792 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:20.281761    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:20.413158 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:20.413123    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:23.552240 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:23.552200    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:31.634664 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:31.634629    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:32.007184 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:32.007150    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:32.108331 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:32.108298    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:32.209151 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:32.209116    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:32.339519 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:32.339443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:38.266283 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:38.266239    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:38.366708 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:38.366676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:38.525408 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:38.525328    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:38.765586 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:38.765554    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:38.949341 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:38.949263    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:39.322462 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:39.322431    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:39.428306 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:39.428263    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:39.521893 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:39.521857    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:39.736748 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:39.736671    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:41.800694 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:41.800662    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:41.902048 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:41.902015    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:45.923547 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:45.923514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:45.995869 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:45.995829    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:46.208146 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:46.208062    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:46.415169 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:46.415140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:46.738877 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:46.738849    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:47.105703 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:47.105673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:47.552432 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:47.552375    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:50.160513 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:50.160479    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:50.285061 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:50.285010    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:50.530550 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:50.530516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:50.865034 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:50.864945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:50.960740 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:50.960709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:54.640756 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:54.640721    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:54.949136 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:54.949044    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:55.272686 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:55.272641    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:55.988151 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:55.988120    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:58.201756 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:58.201678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:58.297725 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:58.297685    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:58.533583 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:58.533550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:58.652220 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:58.652191    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:59.108554 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:59.108516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:59.210311 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:22:59.210273    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:02.682575 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:02.682540    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:08.225544 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.225508    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"]
Jul 07 19:23:08.225907 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.225781    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b8403c-c789-4079-90e9-7028e4a1f374" containerName="main"
Jul 07 19:23:08.225907 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.225793    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b8403c-c789-4079-90e9-7028e4a1f374" containerName="main"
Jul 07 19:23:08.225907 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.225809    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9284e36-01d3-42e1-8326-9573907eed03" containerName="main"
Jul 07 19:23:08.225907 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.225815    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9284e36-01d3-42e1-8326-9573907eed03" containerName="main"
Jul 07 19:23:08.225907 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.225869    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9284e36-01d3-42e1-8326-9573907eed03" containerName="main"
Jul 07 19:23:08.225907 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.225877    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b8403c-c789-4079-90e9-7028e4a1f374" containerName="main"
Jul 07 19:23:08.228699 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.228683    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.231565 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.231547    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"kube-root-ca.crt\""
Jul 07 19:23:08.233032 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.233011    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"openshift-service-ca.crt\""
Jul 07 19:23:08.233135 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.233011    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"default-dockercfg-lnd5g\""
Jul 07 19:23:08.233135 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.233011    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"auth-test-model-6e21d5-kserve-self-signed-certs\""
Jul 07 19:23:08.239396 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.239375    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"]
Jul 07 19:23:08.336178 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.336146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tmp-dir\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.336320 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.336199    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jffsg\" (UniqueName: \"kubernetes.io/projected/1ce6b830-bba6-4de1-83b9-73d02eec3f29-kube-api-access-jffsg\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.336320 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.336248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-dshm\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.336320 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.336268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-home\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.336320 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.336291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-model-cache\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.336624 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.336364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tls-certs\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.346793 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.346749    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:08.437276 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tmp-dir\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.437389 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jffsg\" (UniqueName: \"kubernetes.io/projected/1ce6b830-bba6-4de1-83b9-73d02eec3f29-kube-api-access-jffsg\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.437389 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-dshm\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.437389 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-home\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.437389 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-model-cache\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.437389 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tls-certs\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.437718 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437695    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tmp-dir\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.437794 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437744    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-home\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.437847 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.437795    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-model-cache\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.439539 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.439524    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-dshm\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.439800 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.439783    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tls-certs\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.448631 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.448603    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jffsg\" (UniqueName: \"kubernetes.io/projected/1ce6b830-bba6-4de1-83b9-73d02eec3f29-kube-api-access-jffsg\") pod \"auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") " pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.537501 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.537472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:08.666679 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.666646    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"]
Jul 07 19:23:08.670833 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:23:08.670811    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ce6b830_bba6_4de1_83b9_73d02eec3f29.slice/crio-23b8302922f5204304fa72dc67388a6042117d2c134b90917f66504ff1706575 WatchSource:0}: Error finding container 23b8302922f5204304fa72dc67388a6042117d2c134b90917f66504ff1706575: Status 404 returned error can't find the container with id 23b8302922f5204304fa72dc67388a6042117d2c134b90917f66504ff1706575
Jul 07 19:23:08.907571 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.907477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws" event={"ID":"1ce6b830-bba6-4de1-83b9-73d02eec3f29","Type":"ContainerStarted","Data":"212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d"}
Jul 07 19:23:08.907571 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.907523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws" event={"ID":"1ce6b830-bba6-4de1-83b9-73d02eec3f29","Type":"ContainerStarted","Data":"23b8302922f5204304fa72dc67388a6042117d2c134b90917f66504ff1706575"}
Jul 07 19:23:08.929058 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:08.929016    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws" podStartSLOduration=0.929002112 podStartE2EDuration="929.002112ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:08.927737955 +0000 UTC m=+1984.693845328" watchObservedRunningTime="2026-07-07 19:23:08.929002112 +0000 UTC m=+1984.695109484"
Jul 07 19:23:11.686469 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:11.686389    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:11.790296 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:11.790269    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:18.538066 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:18.538023    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:18.538066 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:18.538077    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:18.550468 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:18.550449    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:18.958100 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:18.958028    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:23:19.863213 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:19.863159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:19.961139 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:19.961079    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:30.029819 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.029785    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"]
Jul 07 19:23:30.033121 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.033100    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.037374 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.037357    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-912fa0\"/\"auth-test-model-912fa0-kserve-self-signed-certs\""
Jul 07 19:23:30.037608 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.037579    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-912fa0\"/\"kube-root-ca.crt\""
Jul 07 19:23:30.037718 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.037586    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-912fa0\"/\"default-dockercfg-hwmrd\""
Jul 07 19:23:30.037718 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.037636    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-912fa0\"/\"openshift-service-ca.crt\""
Jul 07 19:23:30.048207 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.048184    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"]
Jul 07 19:23:30.055836 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.055816    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:30.096655 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.096632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-model-cache\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.096752 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.096681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-home\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.096752 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.096732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm8p2\" (UniqueName: \"kubernetes.io/projected/1715aa8c-0394-450b-b781-7b476475e4d1-kube-api-access-nm8p2\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.096831 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.096776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1715aa8c-0394-450b-b781-7b476475e4d1-tls-certs\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.096831 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.096803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-dshm\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.096831 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.096818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-tmp-dir\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198045 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-model-cache\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198141 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-home\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198205 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm8p2\" (UniqueName: \"kubernetes.io/projected/1715aa8c-0394-450b-b781-7b476475e4d1-kube-api-access-nm8p2\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198250 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1715aa8c-0394-450b-b781-7b476475e4d1-tls-certs\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198298 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-dshm\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198298 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-tmp-dir\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198391 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198363    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-home\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198498 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198480    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-model-cache\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.198606 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.198590    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-tmp-dir\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.200563 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.200543    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-dshm\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.200685 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.200649    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1715aa8c-0394-450b-b781-7b476475e4d1-tls-certs\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.208018 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.207999    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm8p2\" (UniqueName: \"kubernetes.io/projected/1715aa8c-0394-450b-b781-7b476475e4d1-kube-api-access-nm8p2\") pod \"auth-test-model-912fa0-kserve-657b5f7479-87558\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") " pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.342207 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.342136    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:30.478958 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.478926    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"]
Jul 07 19:23:30.482378 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:23:30.482348    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1715aa8c_0394_450b_b781_7b476475e4d1.slice/crio-5002a5c2ae2ff10ff0a957af981db3ee218078a24487de3c625ba105aa0eeba0 WatchSource:0}: Error finding container 5002a5c2ae2ff10ff0a957af981db3ee218078a24487de3c625ba105aa0eeba0: Status 404 returned error can't find the container with id 5002a5c2ae2ff10ff0a957af981db3ee218078a24487de3c625ba105aa0eeba0
Jul 07 19:23:30.997210 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.997171    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558" event={"ID":"1715aa8c-0394-450b-b781-7b476475e4d1","Type":"ContainerStarted","Data":"942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c"}
Jul 07 19:23:30.997379 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:30.997219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558" event={"ID":"1715aa8c-0394-450b-b781-7b476475e4d1","Type":"ContainerStarted","Data":"5002a5c2ae2ff10ff0a957af981db3ee218078a24487de3c625ba105aa0eeba0"}
Jul 07 19:23:31.021722 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:31.021669    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558" podStartSLOduration=1.021652481 podStartE2EDuration="1.021652481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:31.020588604 +0000 UTC m=+2006.786695978" watchObservedRunningTime="2026-07-07 19:23:31.021652481 +0000 UTC m=+2006.787759855"
Jul 07 19:23:40.342815 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:40.342772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:40.342815 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:40.342822    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:40.355094 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:40.355068    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:23:41.045898 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:23:41.045872    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:24:03.892825 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:24:03.892790    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:04.902123 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:04.902090    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:25:04.903895 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:04.903871    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6qpg_eeda4633-f0ab-4f08-8926-47a5bf7a7c1d/ovn-acl-logging/0.log"
Jul 07 19:25:13.896231 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:13.896194    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"]
Jul 07 19:25:13.924252 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:13.924224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:14.727802 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:14.727770    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"]
Jul 07 19:25:14.752080 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:14.752055    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:28.917070 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:28.917005    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws" podUID="1ce6b830-bba6-4de1-83b9-73d02eec3f29" containerName="main" containerID="cri-o://212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d" gracePeriod=45
Jul 07 19:25:28.948052 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:28.948016    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws" podUID="1ce6b830-bba6-4de1-83b9-73d02eec3f29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/ready\": dial tcp 10.133.0.32:8000: connect: connection refused"
Jul 07 19:25:29.158879 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.158854    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:25:29.296835 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.296812    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-model-cache\") pod \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") "
Jul 07 19:25:29.296991 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.296844    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tmp-dir\") pod \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") "
Jul 07 19:25:29.296991 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.296876    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jffsg\" (UniqueName: \"kubernetes.io/projected/1ce6b830-bba6-4de1-83b9-73d02eec3f29-kube-api-access-jffsg\") pod \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") "
Jul 07 19:25:29.296991 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.296894    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tls-certs\") pod \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") "
Jul 07 19:25:29.296991 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.296937    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-home\") pod \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") "
Jul 07 19:25:29.297220 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.297005    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-dshm\") pod \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\" (UID: \"1ce6b830-bba6-4de1-83b9-73d02eec3f29\") "
Jul 07 19:25:29.297220 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.297064    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ce6b830-bba6-4de1-83b9-73d02eec3f29" (UID: "1ce6b830-bba6-4de1-83b9-73d02eec3f29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:29.297220 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.297079    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ce6b830-bba6-4de1-83b9-73d02eec3f29" (UID: "1ce6b830-bba6-4de1-83b9-73d02eec3f29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:29.297336 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.297216    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-home" (OuterVolumeSpecName: "home") pod "1ce6b830-bba6-4de1-83b9-73d02eec3f29" (UID: "1ce6b830-bba6-4de1-83b9-73d02eec3f29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:29.297336 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.297229    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:29.297336 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.297248    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:29.299057 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.299036    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-dshm" (OuterVolumeSpecName: "dshm") pod "1ce6b830-bba6-4de1-83b9-73d02eec3f29" (UID: "1ce6b830-bba6-4de1-83b9-73d02eec3f29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:29.299140 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.299076    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce6b830-bba6-4de1-83b9-73d02eec3f29-kube-api-access-jffsg" (OuterVolumeSpecName: "kube-api-access-jffsg") pod "1ce6b830-bba6-4de1-83b9-73d02eec3f29" (UID: "1ce6b830-bba6-4de1-83b9-73d02eec3f29"). InnerVolumeSpecName "kube-api-access-jffsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:25:29.299181 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.299149    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ce6b830-bba6-4de1-83b9-73d02eec3f29" (UID: "1ce6b830-bba6-4de1-83b9-73d02eec3f29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:25:29.397744 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.397722    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:29.397744 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.397744    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jffsg\" (UniqueName: \"kubernetes.io/projected/1ce6b830-bba6-4de1-83b9-73d02eec3f29-kube-api-access-jffsg\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:29.397873 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.397754    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce6b830-bba6-4de1-83b9-73d02eec3f29-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:29.397873 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.397763    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce6b830-bba6-4de1-83b9-73d02eec3f29-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:29.471601 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.471574    2577 generic.go:356] "Generic (PLEG): container finished" podID="1ce6b830-bba6-4de1-83b9-73d02eec3f29" containerID="212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d" exitCode=0
Jul 07 19:25:29.471699 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.471619    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"
Jul 07 19:25:29.471699 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.471635    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws" event={"ID":"1ce6b830-bba6-4de1-83b9-73d02eec3f29","Type":"ContainerDied","Data":"212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d"}
Jul 07 19:25:29.471699 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.471674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws" event={"ID":"1ce6b830-bba6-4de1-83b9-73d02eec3f29","Type":"ContainerDied","Data":"23b8302922f5204304fa72dc67388a6042117d2c134b90917f66504ff1706575"}
Jul 07 19:25:29.471699 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.471695    2577 scope.go:117] "RemoveContainer" containerID="212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d"
Jul 07 19:25:29.479897 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.479881    2577 scope.go:117] "RemoveContainer" containerID="212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d"
Jul 07 19:25:29.480168 ip-10-0-142-228 kubenswrapper[2577]: E0707 19:25:29.480150    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d\": container with ID starting with 212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d not found: ID does not exist" containerID="212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d"
Jul 07 19:25:29.480215 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.480176    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d"} err="failed to get container status \"212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d\": rpc error: code = NotFound desc = could not find container \"212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d\": container with ID starting with 212423ff465da4c80b86db566d35f12fd828216a4e7375124d7899702e530e5d not found: ID does not exist"
Jul 07 19:25:29.494160 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.494143    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"]
Jul 07 19:25:29.499342 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.499324    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/auth-test-model-6e21d5-kserve-6c798d8f9f-j7cws"]
Jul 07 19:25:29.747557 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.747517    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558" podUID="1715aa8c-0394-450b-b781-7b476475e4d1" containerName="main" containerID="cri-o://942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c" gracePeriod=45
Jul 07 19:25:29.994154 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:29.994132    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:25:30.102664 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.102584    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-home\") pod \"1715aa8c-0394-450b-b781-7b476475e4d1\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") "
Jul 07 19:25:30.102664 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.102639    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-dshm\") pod \"1715aa8c-0394-450b-b781-7b476475e4d1\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") "
Jul 07 19:25:30.102889 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.102681    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1715aa8c-0394-450b-b781-7b476475e4d1-tls-certs\") pod \"1715aa8c-0394-450b-b781-7b476475e4d1\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") "
Jul 07 19:25:30.102889 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.102715    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm8p2\" (UniqueName: \"kubernetes.io/projected/1715aa8c-0394-450b-b781-7b476475e4d1-kube-api-access-nm8p2\") pod \"1715aa8c-0394-450b-b781-7b476475e4d1\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") "
Jul 07 19:25:30.102889 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.102738    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-tmp-dir\") pod \"1715aa8c-0394-450b-b781-7b476475e4d1\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") "
Jul 07 19:25:30.102889 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.102877    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-home" (OuterVolumeSpecName: "home") pod "1715aa8c-0394-450b-b781-7b476475e4d1" (UID: "1715aa8c-0394-450b-b781-7b476475e4d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:30.103095 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.102886    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-model-cache\") pod \"1715aa8c-0394-450b-b781-7b476475e4d1\" (UID: \"1715aa8c-0394-450b-b781-7b476475e4d1\") "
Jul 07 19:25:30.103095 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.103036    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1715aa8c-0394-450b-b781-7b476475e4d1" (UID: "1715aa8c-0394-450b-b781-7b476475e4d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:30.103095 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.103049    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "1715aa8c-0394-450b-b781-7b476475e4d1" (UID: "1715aa8c-0394-450b-b781-7b476475e4d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:30.103243 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.103220    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:30.103243 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.103244    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:30.103391 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.103256    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:30.104911 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.104888    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1715aa8c-0394-450b-b781-7b476475e4d1-kube-api-access-nm8p2" (OuterVolumeSpecName: "kube-api-access-nm8p2") pod "1715aa8c-0394-450b-b781-7b476475e4d1" (UID: "1715aa8c-0394-450b-b781-7b476475e4d1"). InnerVolumeSpecName "kube-api-access-nm8p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:25:30.105094 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.105068    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1715aa8c-0394-450b-b781-7b476475e4d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1715aa8c-0394-450b-b781-7b476475e4d1" (UID: "1715aa8c-0394-450b-b781-7b476475e4d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:25:30.105174 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.105121    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-dshm" (OuterVolumeSpecName: "dshm") pod "1715aa8c-0394-450b-b781-7b476475e4d1" (UID: "1715aa8c-0394-450b-b781-7b476475e4d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:30.204556 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.204534    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1715aa8c-0394-450b-b781-7b476475e4d1-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:30.204556 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.204556    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm8p2\" (UniqueName: \"kubernetes.io/projected/1715aa8c-0394-450b-b781-7b476475e4d1-kube-api-access-nm8p2\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:30.204690 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.204570    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1715aa8c-0394-450b-b781-7b476475e4d1-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:25:30.477381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.477300    2577 generic.go:356] "Generic (PLEG): container finished" podID="1715aa8c-0394-450b-b781-7b476475e4d1" containerID="942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c" exitCode=0
Jul 07 19:25:30.477381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.477341    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"
Jul 07 19:25:30.477381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.477357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558" event={"ID":"1715aa8c-0394-450b-b781-7b476475e4d1","Type":"ContainerDied","Data":"942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c"}
Jul 07 19:25:30.477618 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.477387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558" event={"ID":"1715aa8c-0394-450b-b781-7b476475e4d1","Type":"ContainerDied","Data":"5002a5c2ae2ff10ff0a957af981db3ee218078a24487de3c625ba105aa0eeba0"}
Jul 07 19:25:30.477618 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.477430    2577 scope.go:117] "RemoveContainer" containerID="942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c"
Jul 07 19:25:30.485991 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.485975    2577 scope.go:117] "RemoveContainer" containerID="942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c"
Jul 07 19:25:30.486238 ip-10-0-142-228 kubenswrapper[2577]: E0707 19:25:30.486223    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c\": container with ID starting with 942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c not found: ID does not exist" containerID="942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c"
Jul 07 19:25:30.486283 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.486246    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c"} err="failed to get container status \"942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c\": rpc error: code = NotFound desc = could not find container \"942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c\": container with ID starting with 942bba8a652e6e86ba01b4e211895848ae723a390087380416817c0503f4118c not found: ID does not exist"
Jul 07 19:25:30.499059 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.499036    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"]
Jul 07 19:25:30.501755 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:30.501735    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/auth-test-model-912fa0-kserve-657b5f7479-87558"]
Jul 07 19:25:31.004290 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:31.004260    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1715aa8c-0394-450b-b781-7b476475e4d1" path="/var/lib/kubelet/pods/1715aa8c-0394-450b-b781-7b476475e4d1/volumes"
Jul 07 19:25:31.004666 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:31.004651    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce6b830-bba6-4de1-83b9-73d02eec3f29" path="/var/lib/kubelet/pods/1ce6b830-bba6-4de1-83b9-73d02eec3f29/volumes"
Jul 07 19:25:34.880150 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:34.880111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:42.924318 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.924283    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"]
Jul 07 19:25:42.924683 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.924571    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1715aa8c-0394-450b-b781-7b476475e4d1" containerName="main"
Jul 07 19:25:42.924683 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.924581    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1715aa8c-0394-450b-b781-7b476475e4d1" containerName="main"
Jul 07 19:25:42.924683 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.924599    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce6b830-bba6-4de1-83b9-73d02eec3f29" containerName="main"
Jul 07 19:25:42.924683 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.924604    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce6b830-bba6-4de1-83b9-73d02eec3f29" containerName="main"
Jul 07 19:25:42.924683 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.924652    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce6b830-bba6-4de1-83b9-73d02eec3f29" containerName="main"
Jul 07 19:25:42.924683 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.924662    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1715aa8c-0394-450b-b781-7b476475e4d1" containerName="main"
Jul 07 19:25:42.927324 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.927308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:42.931341 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.931314    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"sub-test-model-6e21d5-kserve-self-signed-certs\""
Jul 07 19:25:42.931486 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.931337    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"default-dockercfg-lnd5g\""
Jul 07 19:25:42.931486 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.931359    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"kube-root-ca.crt\""
Jul 07 19:25:42.931486 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.931337    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"openshift-service-ca.crt\""
Jul 07 19:25:42.937453 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.937432    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"]
Jul 07 19:25:42.948825 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:42.948791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:43.102536 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.102509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vwn\" (UniqueName: \"kubernetes.io/projected/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-kube-api-access-69vwn\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.102662 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.102546    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-model-cache\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.102662 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.102587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-dshm\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.102662 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.102634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tls-certs\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.102783 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.102666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tmp-dir\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.102783 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.102685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-home\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.203942 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.203880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-dshm\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.203942 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.203915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tls-certs\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.203942 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.203934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tmp-dir\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.204150 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.203949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-home\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.204150 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.203977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vwn\" (UniqueName: \"kubernetes.io/projected/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-kube-api-access-69vwn\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.204150 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.204009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-model-cache\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.204376 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.204357    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tmp-dir\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.204459 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.204438    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-model-cache\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.204501 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.204476    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-home\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.206150 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.206130    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-dshm\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.206458 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.206438    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tls-certs\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.212645 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.212624    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vwn\" (UniqueName: \"kubernetes.io/projected/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-kube-api-access-69vwn\") pod \"sub-test-model-6e21d5-kserve-d4d98cb77-44c8j\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") " pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.236470 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.236449    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:43.362467 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.362443    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"]
Jul 07 19:25:43.364696 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:25:43.364670    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e61131f_ebb5_4a29_ada2_4568ee3b2a08.slice/crio-2febbb2c72bb88067b7a17deb032c7611f0cc13fae30474f679f55ebcd339a4b WatchSource:0}: Error finding container 2febbb2c72bb88067b7a17deb032c7611f0cc13fae30474f679f55ebcd339a4b: Status 404 returned error can't find the container with id 2febbb2c72bb88067b7a17deb032c7611f0cc13fae30474f679f55ebcd339a4b
Jul 07 19:25:43.531037 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.531007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j" event={"ID":"5e61131f-ebb5-4a29-ada2-4568ee3b2a08","Type":"ContainerStarted","Data":"b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6"}
Jul 07 19:25:43.531178 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.531048    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j" event={"ID":"5e61131f-ebb5-4a29-ada2-4568ee3b2a08","Type":"ContainerStarted","Data":"2febbb2c72bb88067b7a17deb032c7611f0cc13fae30474f679f55ebcd339a4b"}
Jul 07 19:25:43.552373 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:43.552329    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j" podStartSLOduration=1.5523153189999999 podStartE2EDuration="1.552315319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:25:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:25:43.550773996 +0000 UTC m=+2139.316881482" watchObservedRunningTime="2026-07-07 19:25:43.552315319 +0000 UTC m=+2139.318422691"
Jul 07 19:25:53.237587 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:53.237549    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:53.237587 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:53.237596    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:53.250118 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:53.250097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:25:53.580306 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:25:53.580283    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:26:00.586649 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:26:00.586565    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:26:11.291569 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:26:11.291533    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:26:46.311339 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:26:46.311309    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"]
Jul 07 19:26:46.337478 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:26:46.337445    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:26:47.118534 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:26:47.118503    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:26:52.747553 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:26:52.747502    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:26:52.848189 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:26:52.848154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:27:01.330554 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.330490    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j" podUID="5e61131f-ebb5-4a29-ada2-4568ee3b2a08" containerName="main" containerID="cri-o://b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6" gracePeriod=45
Jul 07 19:27:01.561746 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.561720    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:27:01.674736 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.674671    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tmp-dir\") pod \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") "
Jul 07 19:27:01.674859 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.674744    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-home\") pod \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") "
Jul 07 19:27:01.674859 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.674771    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-dshm\") pod \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") "
Jul 07 19:27:01.674859 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.674821    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69vwn\" (UniqueName: \"kubernetes.io/projected/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-kube-api-access-69vwn\") pod \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") "
Jul 07 19:27:01.674859 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.674841    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-model-cache\") pod \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") "
Jul 07 19:27:01.675058 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.674870    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tls-certs\") pod \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\" (UID: \"5e61131f-ebb5-4a29-ada2-4568ee3b2a08\") "
Jul 07 19:27:01.675058 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.674901    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e61131f-ebb5-4a29-ada2-4568ee3b2a08" (UID: "5e61131f-ebb5-4a29-ada2-4568ee3b2a08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:27:01.675058 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.675010    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-home" (OuterVolumeSpecName: "home") pod "5e61131f-ebb5-4a29-ada2-4568ee3b2a08" (UID: "5e61131f-ebb5-4a29-ada2-4568ee3b2a08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:27:01.675173 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.675134    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e61131f-ebb5-4a29-ada2-4568ee3b2a08" (UID: "5e61131f-ebb5-4a29-ada2-4568ee3b2a08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:27:01.675173 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.675153    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:27:01.675249 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.675175    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:27:01.676747 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.676725    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-dshm" (OuterVolumeSpecName: "dshm") pod "5e61131f-ebb5-4a29-ada2-4568ee3b2a08" (UID: "5e61131f-ebb5-4a29-ada2-4568ee3b2a08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:27:01.676883 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.676864    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e61131f-ebb5-4a29-ada2-4568ee3b2a08" (UID: "5e61131f-ebb5-4a29-ada2-4568ee3b2a08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:27:01.676944 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.676877    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-kube-api-access-69vwn" (OuterVolumeSpecName: "kube-api-access-69vwn") pod "5e61131f-ebb5-4a29-ada2-4568ee3b2a08" (UID: "5e61131f-ebb5-4a29-ada2-4568ee3b2a08"). InnerVolumeSpecName "kube-api-access-69vwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:27:01.776386 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.776359    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:27:01.776386 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.776384    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69vwn\" (UniqueName: \"kubernetes.io/projected/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-kube-api-access-69vwn\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:27:01.776548 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.776394    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:27:01.776548 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.776404    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e61131f-ebb5-4a29-ada2-4568ee3b2a08-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:27:01.845190 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.845164    2577 generic.go:356] "Generic (PLEG): container finished" podID="5e61131f-ebb5-4a29-ada2-4568ee3b2a08" containerID="b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6" exitCode=0
Jul 07 19:27:01.845298 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.845205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j" event={"ID":"5e61131f-ebb5-4a29-ada2-4568ee3b2a08","Type":"ContainerDied","Data":"b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6"}
Jul 07 19:27:01.845298 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.845217    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"
Jul 07 19:27:01.845298 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.845232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j" event={"ID":"5e61131f-ebb5-4a29-ada2-4568ee3b2a08","Type":"ContainerDied","Data":"2febbb2c72bb88067b7a17deb032c7611f0cc13fae30474f679f55ebcd339a4b"}
Jul 07 19:27:01.845298 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.845250    2577 scope.go:117] "RemoveContainer" containerID="b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6"
Jul 07 19:27:01.854119 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.854102    2577 scope.go:117] "RemoveContainer" containerID="b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6"
Jul 07 19:27:01.854358 ip-10-0-142-228 kubenswrapper[2577]: E0707 19:27:01.854341    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6\": container with ID starting with b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6 not found: ID does not exist" containerID="b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6"
Jul 07 19:27:01.854466 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.854366    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6"} err="failed to get container status \"b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6\": rpc error: code = NotFound desc = could not find container \"b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6\": container with ID starting with b4ee83913773a5d050ad480a16e9de07ccd20a95d8d17089a52c3b62cb75e1f6 not found: ID does not exist"
Jul 07 19:27:01.867830 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.867810    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"]
Jul 07 19:27:01.872017 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:01.871996    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/sub-test-model-6e21d5-kserve-d4d98cb77-44c8j"]
Jul 07 19:27:03.004025 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:03.003991    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e61131f-ebb5-4a29-ada2-4568ee3b2a08" path="/var/lib/kubelet/pods/5e61131f-ebb5-4a29-ada2-4568ee3b2a08/volumes"
Jul 07 19:27:06.318131 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.318101    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"]
Jul 07 19:27:06.318519 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.318390    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e61131f-ebb5-4a29-ada2-4568ee3b2a08" containerName="main"
Jul 07 19:27:06.318519 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.318401    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e61131f-ebb5-4a29-ada2-4568ee3b2a08" containerName="main"
Jul 07 19:27:06.318519 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.318481    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e61131f-ebb5-4a29-ada2-4568ee3b2a08" containerName="main"
Jul 07 19:27:06.322720 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.322701    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.326978 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.326953    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"openshift-service-ca.crt\""
Jul 07 19:27:06.327094 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.326979    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"kube-root-ca.crt\""
Jul 07 19:27:06.327094 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.327028    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"rate-test-model-6e21d5-kserve-self-signed-certs\""
Jul 07 19:27:06.327094 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.326953    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e21d5\"/\"default-dockercfg-lnd5g\""
Jul 07 19:27:06.335532 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.335510    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"]
Jul 07 19:27:06.357544 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.357521    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:27:06.414255 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.414230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-tmp-dir\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.414384 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.414264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94404d52-436d-4a86-ada5-77646216fe32-tls-certs\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.414384 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.414296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-model-cache\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.414384 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.414325    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsjnn\" (UniqueName: \"kubernetes.io/projected/94404d52-436d-4a86-ada5-77646216fe32-kube-api-access-bsjnn\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.414384 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.414351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-home\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.414536 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.414463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-dshm\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.515563 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.515537    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-dshm\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.515653 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.515574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-tmp-dir\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.515653 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.515603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94404d52-436d-4a86-ada5-77646216fe32-tls-certs\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.515653 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.515629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-model-cache\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.515653 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.515648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsjnn\" (UniqueName: \"kubernetes.io/projected/94404d52-436d-4a86-ada5-77646216fe32-kube-api-access-bsjnn\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.515831 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.515669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-home\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.516051 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.516027    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-model-cache\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.516051 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.516039    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-tmp-dir\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.516190 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.516119    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-home\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.517769 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.517750    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-dshm\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.518016 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.517998    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94404d52-436d-4a86-ada5-77646216fe32-tls-certs\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.524750 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.524717    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsjnn\" (UniqueName: \"kubernetes.io/projected/94404d52-436d-4a86-ada5-77646216fe32-kube-api-access-bsjnn\") pod \"rate-test-model-6e21d5-kserve-7567b997cf-62ql2\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") " pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.632180 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.632131    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:06.759080 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.759058    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"]
Jul 07 19:27:06.760963 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:27:06.760938    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94404d52_436d_4a86_ada5_77646216fe32.slice/crio-b01c9c35834b05365cf2f24e93de8d872a45d8e94ea683d59ead2e2c2d94044b WatchSource:0}: Error finding container b01c9c35834b05365cf2f24e93de8d872a45d8e94ea683d59ead2e2c2d94044b: Status 404 returned error can't find the container with id b01c9c35834b05365cf2f24e93de8d872a45d8e94ea683d59ead2e2c2d94044b
Jul 07 19:27:06.868875 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.868845    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2" event={"ID":"94404d52-436d-4a86-ada5-77646216fe32","Type":"ContainerStarted","Data":"f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81"}
Jul 07 19:27:06.869023 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.868883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2" event={"ID":"94404d52-436d-4a86-ada5-77646216fe32","Type":"ContainerStarted","Data":"b01c9c35834b05365cf2f24e93de8d872a45d8e94ea683d59ead2e2c2d94044b"}
Jul 07 19:27:06.887490 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:06.887390    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2" podStartSLOduration=0.887374817 podStartE2EDuration="887.374817ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:27:06.886236425 +0000 UTC m=+2222.652343798" watchObservedRunningTime="2026-07-07 19:27:06.887374817 +0000 UTC m=+2222.653482190"
Jul 07 19:27:16.632875 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:16.632838    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:16.633366 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:16.632891    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:16.645130 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:16.645105    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:16.921659 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:16.921583    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:27:27.035199 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:27.035117    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:27:35.324837 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.324807    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"]
Jul 07 19:27:35.327675 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.327651    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.331637 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.331614    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-912fa0\"/\"default-dockercfg-hwmrd\""
Jul 07 19:27:35.331790 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.331617    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-912fa0\"/\"kube-root-ca.crt\""
Jul 07 19:27:35.331912 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.331625    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-912fa0\"/\"openshift-service-ca.crt\""
Jul 07 19:27:35.331981 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.331646    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-912fa0\"/\"rate-test-model-912fa0-kserve-self-signed-certs\""
Jul 07 19:27:35.339441 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.339400    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"]
Jul 07 19:27:35.413301 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.413254    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:27:35.425252 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.425228    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-dshm\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.425340 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.425259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89466dba-5137-448f-84b3-ed49581035b7-tls-certs\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.425340 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.425278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-model-cache\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.425340 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.425299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-tmp-dir\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.425467 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.425389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-home\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.425467 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.425462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spw6v\" (UniqueName: \"kubernetes.io/projected/89466dba-5137-448f-84b3-ed49581035b7-kube-api-access-spw6v\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526211 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-home\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526336 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spw6v\" (UniqueName: \"kubernetes.io/projected/89466dba-5137-448f-84b3-ed49581035b7-kube-api-access-spw6v\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526336 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-dshm\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526336 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89466dba-5137-448f-84b3-ed49581035b7-tls-certs\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526336 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-model-cache\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526530 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-tmp-dir\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526667 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526645    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-home\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526732 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526710    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-tmp-dir\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.526791 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.526748    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-model-cache\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.528563 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.528544    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-dshm\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.528817 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.528799    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89466dba-5137-448f-84b3-ed49581035b7-tls-certs\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.535329 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.535304    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spw6v\" (UniqueName: \"kubernetes.io/projected/89466dba-5137-448f-84b3-ed49581035b7-kube-api-access-spw6v\") pod \"rate-test-model-912fa0-kserve-684d76d99f-qznng\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") " pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.637388 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.637331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:35.768129 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.768103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"]
Jul 07 19:27:35.770396 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:27:35.770373    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89466dba_5137_448f_84b3_ed49581035b7.slice/crio-01789c90ccaafc086f5200ee000376729fffd5e3f238769e65c13a030670ad83 WatchSource:0}: Error finding container 01789c90ccaafc086f5200ee000376729fffd5e3f238769e65c13a030670ad83: Status 404 returned error can't find the container with id 01789c90ccaafc086f5200ee000376729fffd5e3f238769e65c13a030670ad83
Jul 07 19:27:35.987937 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.987843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng" event={"ID":"89466dba-5137-448f-84b3-ed49581035b7","Type":"ContainerStarted","Data":"79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420"}
Jul 07 19:27:35.987937 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:35.987890    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng" event={"ID":"89466dba-5137-448f-84b3-ed49581035b7","Type":"ContainerStarted","Data":"01789c90ccaafc086f5200ee000376729fffd5e3f238769e65c13a030670ad83"}
Jul 07 19:27:36.019539 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:36.019488    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng" podStartSLOduration=1.019472818 podStartE2EDuration="1.019472818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:27:36.019178798 +0000 UTC m=+2251.785286171" watchObservedRunningTime="2026-07-07 19:27:36.019472818 +0000 UTC m=+2251.785580190"
Jul 07 19:27:42.754380 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:42.754344    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:27:42.924047 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:42.924013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:27:45.638301 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:45.638264    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:45.638698 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:45.638335    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:45.650703 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:45.650681    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:27:46.038097 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:27:46.038068    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:28:12.416383 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:12.416347    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:12.521784 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:12.521743    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:19.111101 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:19.111069    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"]
Jul 07 19:28:19.143318 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:19.143290    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:19.931129 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:19.931097    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"]
Jul 07 19:28:19.962339 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:19.962309    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:20.655456 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:20.655378    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:20.754969 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:20.754942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:21.105318 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:21.105291    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:21.473622 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:21.473534    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:21.596352 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:21.596321    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:21.694374 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:21.694335    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:21.977690 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:21.977659    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:26.541881 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:26.541847    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:28:34.130461 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.130403    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2" podUID="94404d52-436d-4a86-ada5-77646216fe32" containerName="main" containerID="cri-o://f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81" gracePeriod=45
Jul 07 19:28:34.371304 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.371276    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:28:34.380199 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380181    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-model-cache\") pod \"94404d52-436d-4a86-ada5-77646216fe32\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") "
Jul 07 19:28:34.380291 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380211    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-home\") pod \"94404d52-436d-4a86-ada5-77646216fe32\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") "
Jul 07 19:28:34.380291 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380228    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsjnn\" (UniqueName: \"kubernetes.io/projected/94404d52-436d-4a86-ada5-77646216fe32-kube-api-access-bsjnn\") pod \"94404d52-436d-4a86-ada5-77646216fe32\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") "
Jul 07 19:28:34.380291 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380261    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-tmp-dir\") pod \"94404d52-436d-4a86-ada5-77646216fe32\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") "
Jul 07 19:28:34.380291 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380280    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94404d52-436d-4a86-ada5-77646216fe32-tls-certs\") pod \"94404d52-436d-4a86-ada5-77646216fe32\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") "
Jul 07 19:28:34.380585 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380317    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-dshm\") pod \"94404d52-436d-4a86-ada5-77646216fe32\" (UID: \"94404d52-436d-4a86-ada5-77646216fe32\") "
Jul 07 19:28:34.380585 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380442    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-model-cache" (OuterVolumeSpecName: "model-cache") pod "94404d52-436d-4a86-ada5-77646216fe32" (UID: "94404d52-436d-4a86-ada5-77646216fe32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:34.380585 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380477    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-home" (OuterVolumeSpecName: "home") pod "94404d52-436d-4a86-ada5-77646216fe32" (UID: "94404d52-436d-4a86-ada5-77646216fe32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:34.380585 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380542    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:34.380585 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.380566    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "94404d52-436d-4a86-ada5-77646216fe32" (UID: "94404d52-436d-4a86-ada5-77646216fe32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:34.382213 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.382190    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94404d52-436d-4a86-ada5-77646216fe32-kube-api-access-bsjnn" (OuterVolumeSpecName: "kube-api-access-bsjnn") pod "94404d52-436d-4a86-ada5-77646216fe32" (UID: "94404d52-436d-4a86-ada5-77646216fe32"). InnerVolumeSpecName "kube-api-access-bsjnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:28:34.382403 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.382376    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-dshm" (OuterVolumeSpecName: "dshm") pod "94404d52-436d-4a86-ada5-77646216fe32" (UID: "94404d52-436d-4a86-ada5-77646216fe32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:34.382539 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.382481    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94404d52-436d-4a86-ada5-77646216fe32-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "94404d52-436d-4a86-ada5-77646216fe32" (UID: "94404d52-436d-4a86-ada5-77646216fe32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:28:34.481592 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.481561    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:34.481592 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.481588    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsjnn\" (UniqueName: \"kubernetes.io/projected/94404d52-436d-4a86-ada5-77646216fe32-kube-api-access-bsjnn\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:34.481592 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.481598    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:34.481797 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.481608    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94404d52-436d-4a86-ada5-77646216fe32-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:34.481797 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.481616    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94404d52-436d-4a86-ada5-77646216fe32-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:34.950111 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:34.950058    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng" podUID="89466dba-5137-448f-84b3-ed49581035b7" containerName="main" containerID="cri-o://79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420" gracePeriod=45
Jul 07 19:28:35.193424 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.193389    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:28:35.218724 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.218655    2577 generic.go:356] "Generic (PLEG): container finished" podID="89466dba-5137-448f-84b3-ed49581035b7" containerID="79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420" exitCode=0
Jul 07 19:28:35.218724 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.218698    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"
Jul 07 19:28:35.218912 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.218737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng" event={"ID":"89466dba-5137-448f-84b3-ed49581035b7","Type":"ContainerDied","Data":"79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420"}
Jul 07 19:28:35.218912 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.218784    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng" event={"ID":"89466dba-5137-448f-84b3-ed49581035b7","Type":"ContainerDied","Data":"01789c90ccaafc086f5200ee000376729fffd5e3f238769e65c13a030670ad83"}
Jul 07 19:28:35.218912 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.218808    2577 scope.go:117] "RemoveContainer" containerID="79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420"
Jul 07 19:28:35.220063 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.220037    2577 generic.go:356] "Generic (PLEG): container finished" podID="94404d52-436d-4a86-ada5-77646216fe32" containerID="f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81" exitCode=0
Jul 07 19:28:35.220171 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.220070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2" event={"ID":"94404d52-436d-4a86-ada5-77646216fe32","Type":"ContainerDied","Data":"f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81"}
Jul 07 19:28:35.220171 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.220117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2" event={"ID":"94404d52-436d-4a86-ada5-77646216fe32","Type":"ContainerDied","Data":"b01c9c35834b05365cf2f24e93de8d872a45d8e94ea683d59ead2e2c2d94044b"}
Jul 07 19:28:35.220171 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.220079    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"
Jul 07 19:28:35.229403 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.227660    2577 scope.go:117] "RemoveContainer" containerID="79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420"
Jul 07 19:28:35.229403 ip-10-0-142-228 kubenswrapper[2577]: E0707 19:28:35.229355    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420\": container with ID starting with 79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420 not found: ID does not exist" containerID="79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420"
Jul 07 19:28:35.229403 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.229381    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420"} err="failed to get container status \"79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420\": rpc error: code = NotFound desc = could not find container \"79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420\": container with ID starting with 79390f9e94eaa1a59c3ce9a36026aedf632ea850452a674959ba12c66bc43420 not found: ID does not exist"
Jul 07 19:28:35.229403 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.229404    2577 scope.go:117] "RemoveContainer" containerID="f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81"
Jul 07 19:28:35.237770 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.237751    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"]
Jul 07 19:28:35.238361 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.238339    2577 scope.go:117] "RemoveContainer" containerID="f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81"
Jul 07 19:28:35.238664 ip-10-0-142-228 kubenswrapper[2577]: E0707 19:28:35.238646    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81\": container with ID starting with f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81 not found: ID does not exist" containerID="f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81"
Jul 07 19:28:35.238740 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.238668    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81"} err="failed to get container status \"f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81\": rpc error: code = NotFound desc = could not find container \"f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81\": container with ID starting with f54fadc68e23ed1114e75c9e2a59dc866d91059f220d00980485214aca44aa81 not found: ID does not exist"
Jul 07 19:28:35.243998 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.243975    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6e21d5/rate-test-model-6e21d5-kserve-7567b997cf-62ql2"]
Jul 07 19:28:35.288973 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.288949    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-model-cache\") pod \"89466dba-5137-448f-84b3-ed49581035b7\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") "
Jul 07 19:28:35.289080 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.288984    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-tmp-dir\") pod \"89466dba-5137-448f-84b3-ed49581035b7\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") "
Jul 07 19:28:35.289080 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289027    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-dshm\") pod \"89466dba-5137-448f-84b3-ed49581035b7\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") "
Jul 07 19:28:35.289080 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289068    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spw6v\" (UniqueName: \"kubernetes.io/projected/89466dba-5137-448f-84b3-ed49581035b7-kube-api-access-spw6v\") pod \"89466dba-5137-448f-84b3-ed49581035b7\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") "
Jul 07 19:28:35.289252 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289130    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-home\") pod \"89466dba-5137-448f-84b3-ed49581035b7\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") "
Jul 07 19:28:35.289252 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289194    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89466dba-5137-448f-84b3-ed49581035b7-tls-certs\") pod \"89466dba-5137-448f-84b3-ed49581035b7\" (UID: \"89466dba-5137-448f-84b3-ed49581035b7\") "
Jul 07 19:28:35.289252 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289194    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "89466dba-5137-448f-84b3-ed49581035b7" (UID: "89466dba-5137-448f-84b3-ed49581035b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:35.289395 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289302    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "89466dba-5137-448f-84b3-ed49581035b7" (UID: "89466dba-5137-448f-84b3-ed49581035b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:35.289482 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289448    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-model-cache\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:35.289482 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289473    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-tmp-dir\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:35.289482 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.289445    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-home" (OuterVolumeSpecName: "home") pod "89466dba-5137-448f-84b3-ed49581035b7" (UID: "89466dba-5137-448f-84b3-ed49581035b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:35.291129 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.291109    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-dshm" (OuterVolumeSpecName: "dshm") pod "89466dba-5137-448f-84b3-ed49581035b7" (UID: "89466dba-5137-448f-84b3-ed49581035b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:35.291129 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.291116    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89466dba-5137-448f-84b3-ed49581035b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "89466dba-5137-448f-84b3-ed49581035b7" (UID: "89466dba-5137-448f-84b3-ed49581035b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:28:35.291229 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.291194    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89466dba-5137-448f-84b3-ed49581035b7-kube-api-access-spw6v" (OuterVolumeSpecName: "kube-api-access-spw6v") pod "89466dba-5137-448f-84b3-ed49581035b7" (UID: "89466dba-5137-448f-84b3-ed49581035b7"). InnerVolumeSpecName "kube-api-access-spw6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:28:35.389848 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.389822    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89466dba-5137-448f-84b3-ed49581035b7-tls-certs\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:35.389848 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.389847    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-dshm\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:35.390023 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.389862    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spw6v\" (UniqueName: \"kubernetes.io/projected/89466dba-5137-448f-84b3-ed49581035b7-kube-api-access-spw6v\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:35.390023 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.389877    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89466dba-5137-448f-84b3-ed49581035b7-home\") on node \"ip-10-0-142-228.ec2.internal\" DevicePath \"\""
Jul 07 19:28:35.540932 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.540907    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"]
Jul 07 19:28:35.545438 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:35.545398    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-912fa0/rate-test-model-912fa0-kserve-684d76d99f-qznng"]
Jul 07 19:28:37.003781 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:37.003748    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89466dba-5137-448f-84b3-ed49581035b7" path="/var/lib/kubelet/pods/89466dba-5137-448f-84b3-ed49581035b7/volumes"
Jul 07 19:28:37.004138 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:28:37.004124    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94404d52-436d-4a86-ada5-77646216fe32" path="/var/lib/kubelet/pods/94404d52-436d-4a86-ada5-77646216fe32/volumes"
Jul 07 19:29:03.632815 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:03.632771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:03.985139 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:03.984995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:04.161447 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:04.161400    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:04.331654 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:04.331617    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:04.748469 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:04.748437    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:05.032314 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:05.032237    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:05.135256 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:05.135228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:05.324449 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:05.324347    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:11.060507 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:11.060442    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:11.163561 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:11.163526    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:11.494182 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:11.494148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:11.876966 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:11.876882    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:12.061475 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:12.061445    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5df569699c-wk2qb_041fd0df-8137-4f3a-b5f9-e23388c11d1c/authorino/0.log"
Jul 07 19:29:17.558167 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:17.558137    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64dd56d745-86zxr_3d8949cd-270d-4b42-9db0-6410b0626fa8/copy-manifests/0.log"
Jul 07 19:29:17.576398 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:17.576369    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64dd56d745-86zxr_3d8949cd-270d-4b42-9db0-6410b0626fa8/manager/0.log"
Jul 07 19:29:19.269738 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:19.269711    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5df569699c-wk2qb_041fd0df-8137-4f3a-b5f9-e23388c11d1c/authorino/0.log"
Jul 07 19:29:20.669348 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:20.669319    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5598bb98cc-7l4gw_89c4d960-5ef6-45d3-ac9e-da70008811db/kube-auth-proxy/0.log"
Jul 07 19:29:21.585940 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:21.585911    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8d6ml_45aa2a27-7848-4f45-a71c-b8231c746815/main/0.log"
Jul 07 19:29:21.813920 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:21.813888    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rt24d_118bfab6-8c8b-4836-bef9-de11feb55185/main/0.log"
Jul 07 19:29:22.139546 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:22.139516    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-ct6r2_f391e443-3698-44a8-bde8-c48ab09e3c94/main/0.log"
Jul 07 19:29:26.413137 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.413108    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5qrll/must-gather-cgpsj"]
Jul 07 19:29:26.413512 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.413375    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89466dba-5137-448f-84b3-ed49581035b7" containerName="main"
Jul 07 19:29:26.413512 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.413385    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="89466dba-5137-448f-84b3-ed49581035b7" containerName="main"
Jul 07 19:29:26.413512 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.413403    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94404d52-436d-4a86-ada5-77646216fe32" containerName="main"
Jul 07 19:29:26.413512 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.413431    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="94404d52-436d-4a86-ada5-77646216fe32" containerName="main"
Jul 07 19:29:26.413512 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.413486    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="89466dba-5137-448f-84b3-ed49581035b7" containerName="main"
Jul 07 19:29:26.413512 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.413493    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="94404d52-436d-4a86-ada5-77646216fe32" containerName="main"
Jul 07 19:29:26.416385 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.416367    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qrll/must-gather-cgpsj"
Jul 07 19:29:26.418662 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.418634    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:26.419284 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.419259    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5qrll\"/\"openshift-service-ca.crt\""
Jul 07 19:29:26.419384 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.419259    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5qrll\"/\"default-dockercfg-d64b8\""
Jul 07 19:29:26.420655 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.420639    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5qrll\"/\"kube-root-ca.crt\""
Jul 07 19:29:26.426284 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.426265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qrll/must-gather-cgpsj"]
Jul 07 19:29:26.520442 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.520406    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log" limit=1024
Jul 07 19:29:26.568030 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.567997    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a0b29622-e6ad-457d-bce1-dc655d9abe97-must-gather-output\") pod \"must-gather-cgpsj\" (UID: \"a0b29622-e6ad-457d-bce1-dc655d9abe97\") " pod="openshift-must-gather-5qrll/must-gather-cgpsj"
Jul 07 19:29:26.568133 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.568041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqwjf\" (UniqueName: \"kubernetes.io/projected/a0b29622-e6ad-457d-bce1-dc655d9abe97-kube-api-access-mqwjf\") pod \"must-gather-cgpsj\" (UID: \"a0b29622-e6ad-457d-bce1-dc655d9abe97\") " pod="openshift-must-gather-5qrll/must-gather-cgpsj"
Jul 07 19:29:26.669052 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.668950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a0b29622-e6ad-457d-bce1-dc655d9abe97-must-gather-output\") pod \"must-gather-cgpsj\" (UID: \"a0b29622-e6ad-457d-bce1-dc655d9abe97\") " pod="openshift-must-gather-5qrll/must-gather-cgpsj"
Jul 07 19:29:26.669052 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.669005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqwjf\" (UniqueName: \"kubernetes.io/projected/a0b29622-e6ad-457d-bce1-dc655d9abe97-kube-api-access-mqwjf\") pod \"must-gather-cgpsj\" (UID: \"a0b29622-e6ad-457d-bce1-dc655d9abe97\") " pod="openshift-must-gather-5qrll/must-gather-cgpsj"
Jul 07 19:29:26.669390 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.669365    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a0b29622-e6ad-457d-bce1-dc655d9abe97-must-gather-output\") pod \"must-gather-cgpsj\" (UID: \"a0b29622-e6ad-457d-bce1-dc655d9abe97\") " pod="openshift-must-gather-5qrll/must-gather-cgpsj"
Jul 07 19:29:26.680522 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.680492    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqwjf\" (UniqueName: \"kubernetes.io/projected/a0b29622-e6ad-457d-bce1-dc655d9abe97-kube-api-access-mqwjf\") pod \"must-gather-cgpsj\" (UID: \"a0b29622-e6ad-457d-bce1-dc655d9abe97\") " pod="openshift-must-gather-5qrll/must-gather-cgpsj"
Jul 07 19:29:26.726222 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.726196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qrll/must-gather-cgpsj"
Jul 07 19:29:26.851710 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.851511    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qrll/must-gather-cgpsj"]
Jul 07 19:29:26.853793 ip-10-0-142-228 kubenswrapper[2577]: W0707 19:29:26.853768    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0b29622_e6ad_457d_bce1_dc655d9abe97.slice/crio-22baf1455ee319b66a3b8d676be5a5d183c8b4d4c931226dee52cbc5633eac0c WatchSource:0}: Error finding container 22baf1455ee319b66a3b8d676be5a5d183c8b4d4c931226dee52cbc5633eac0c: Status 404 returned error can't find the container with id 22baf1455ee319b66a3b8d676be5a5d183c8b4d4c931226dee52cbc5633eac0c
Jul 07 19:29:26.855688 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:26.855674    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:29:27.422863 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:27.422830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qrll/must-gather-cgpsj" event={"ID":"a0b29622-e6ad-457d-bce1-dc655d9abe97","Type":"ContainerStarted","Data":"22baf1455ee319b66a3b8d676be5a5d183c8b4d4c931226dee52cbc5633eac0c"}
Jul 07 19:29:28.430488 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:28.430328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qrll/must-gather-cgpsj" event={"ID":"a0b29622-e6ad-457d-bce1-dc655d9abe97","Type":"ContainerStarted","Data":"c75afd41e81a352e2c495da551a3411a3e53c1c1955d8ae1276642e4d011c7ca"}
Jul 07 19:29:28.430488 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:28.430384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qrll/must-gather-cgpsj" event={"ID":"a0b29622-e6ad-457d-bce1-dc655d9abe97","Type":"ContainerStarted","Data":"3a73e807dc92aa4aaf6b305c5e11bda92738a254d6592d456a2ab1857a0f8e61"}
Jul 07 19:29:28.450310 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:28.450265    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5qrll/must-gather-cgpsj" podStartSLOduration=1.5730751139999999 podStartE2EDuration="2.450249921s" totalImagesPullingTime="877.174807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:29:28.448964923 +0000 UTC m=+2364.215072299" watchObservedRunningTime="2026-07-07 19:29:28.450249921 +0000 UTC m=+2364.216357293"
Jul 07 19:29:29.344628 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:29.344593    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hrwfd_5d65a8f1-ab8f-46d0-a54b-aebd01376b95/global-pull-secret-syncer/0.log"
Jul 07 19:29:29.507253 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:29.507221    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6zd52_5a38c374-ad30-41f0-a749-58add7354c77/konnectivity-agent/0.log"
Jul 07 19:29:29.624904 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:29.624825    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-228.ec2.internal_1031a34e2c9fcb7ef3b4306f0e919116/haproxy/0.log"
Jul 07 19:29:34.235433 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:34.234624    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5df569699c-wk2qb_041fd0df-8137-4f3a-b5f9-e23388c11d1c/authorino/0.log"
Jul 07 19:29:36.564459 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:36.564428    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zbw8_170db113-c3b3-475a-8cd5-2da922e17f7f/node-exporter/0.log"
Jul 07 19:29:36.590137 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:36.590062    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zbw8_170db113-c3b3-475a-8cd5-2da922e17f7f/kube-rbac-proxy/0.log"
Jul 07 19:29:36.626293 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:36.626254    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zbw8_170db113-c3b3-475a-8cd5-2da922e17f7f/init-textfile/0.log"
Jul 07 19:29:38.701041 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:38.701009    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-f9jjh_37fd92d4-1cd4-4577-a8f4-6a60e66e17d7/networking-console-plugin/0.log"
Jul 07 19:29:39.416613 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.416559    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"]
Jul 07 19:29:39.419727 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.419702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.434076 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.432888    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"]
Jul 07 19:29:39.606183 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.606132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-podres\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.606381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.606198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-sys\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.606381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.606310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddgvf\" (UniqueName: \"kubernetes.io/projected/75ef8c2d-0c75-4052-9915-a38ea5f83bad-kube-api-access-ddgvf\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.606381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.606343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-proc\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.606381 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.606375    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-lib-modules\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.707429 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.707327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddgvf\" (UniqueName: \"kubernetes.io/projected/75ef8c2d-0c75-4052-9915-a38ea5f83bad-kube-api-access-ddgvf\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.707968 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.707942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-proc\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.708105 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.708078    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-proc\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.708276 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.708085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-lib-modules\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.708449 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.708427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-podres\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.708599 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.708582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-sys\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.708856 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.708839    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-sys\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.708968 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.708213    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-lib-modules\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.709204 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.709184    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/75ef8c2d-0c75-4052-9915-a38ea5f83bad-podres\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.718018 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.717990    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddgvf\" (UniqueName: \"kubernetes.io/projected/75ef8c2d-0c75-4052-9915-a38ea5f83bad-kube-api-access-ddgvf\") pod \"perf-node-gather-daemonset-9sxkk\" (UID: \"75ef8c2d-0c75-4052-9915-a38ea5f83bad\") " pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.735995 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.735967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:39.887034 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:39.887011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"]
Jul 07 19:29:40.522310 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:40.522266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk" event={"ID":"75ef8c2d-0c75-4052-9915-a38ea5f83bad","Type":"ContainerStarted","Data":"d6f6466a8ce6bfd7d299a069c031376ce5906883356bfcca1eea516f18892b65"}
Jul 07 19:29:40.522506 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:40.522344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk" event={"ID":"75ef8c2d-0c75-4052-9915-a38ea5f83bad","Type":"ContainerStarted","Data":"7b93aa91883946483f21a4bd04cd75134550e047c4186de5de33d73d1016f1dd"}
Jul 07 19:29:40.522506 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:40.522371    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:40.541877 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:40.541826    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk" podStartSLOduration=1.5418106219999999 podStartE2EDuration="1.541810622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:29:40.540653205 +0000 UTC m=+2376.306760577" watchObservedRunningTime="2026-07-07 19:29:40.541810622 +0000 UTC m=+2376.307918006"
Jul 07 19:29:41.639483 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:41.639456    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n8jnp_c7ceefaf-6695-46d9-b707-e4f0cd270c98/dns/0.log"
Jul 07 19:29:41.666906 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:41.666881    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n8jnp_c7ceefaf-6695-46d9-b707-e4f0cd270c98/kube-rbac-proxy/0.log"
Jul 07 19:29:41.769435 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:41.769381    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8w5xp_bbaf2cd6-c6bb-46bf-9540-c056445ce658/dns-node-resolver/0.log"
Jul 07 19:29:42.417871 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:42.417845    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d97967857-9c2pc_4da0eb64-be53-4c60-8ddf-001484c1ec31/registry/0.log"
Jul 07 19:29:42.444806 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:42.444734    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qj68x_461b6e43-3eb4-437e-99a6-9675ea6c3e16/node-ca/0.log"
Jul 07 19:29:43.649683 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:43.649657    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5598bb98cc-7l4gw_89c4d960-5ef6-45d3-ac9e-da70008811db/kube-auth-proxy/0.log"
Jul 07 19:29:44.590039 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:44.590007    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qbhpz_0eddf42a-b931-44a5-8b14-c18b6ef4fd59/serve-healthcheck-canary/0.log"
Jul 07 19:29:45.272247 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:45.272218    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqxgn_5a8f543a-7988-4530-a7b6-fa1e4415546a/kube-rbac-proxy/0.log"
Jul 07 19:29:45.297250 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:45.297224    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqxgn_5a8f543a-7988-4530-a7b6-fa1e4415546a/exporter/0.log"
Jul 07 19:29:45.322470 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:45.322439    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqxgn_5a8f543a-7988-4530-a7b6-fa1e4415546a/extractor/0.log"
Jul 07 19:29:46.536884 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:46.536856    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5qrll/perf-node-gather-daemonset-9sxkk"
Jul 07 19:29:48.253436 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:48.253381    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64dd56d745-86zxr_3d8949cd-270d-4b42-9db0-6410b0626fa8/manager/0.log"
Jul 07 19:29:48.272565 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:48.272539    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64dd56d745-86zxr_3d8949cd-270d-4b42-9db0-6410b0626fa8/copy-manifests/0.log"
Jul 07 19:29:49.603187 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:49.603156    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5598bb98cc-7l4gw_89c4d960-5ef6-45d3-ac9e-da70008811db/kube-auth-proxy/0.log"
Jul 07 19:29:49.789019 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:49.788985    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-759f8b6db6-jdwth_02eb83dc-f3f7-41d6-b247-96d27fabe23d/manager/0.log"
Jul 07 19:29:51.197273 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:51.197237    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5598bb98cc-7l4gw_89c4d960-5ef6-45d3-ac9e-da70008811db/kube-auth-proxy/0.log"
Jul 07 19:29:54.825681 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:54.825649    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-gb2zh_b06eb2b9-81ca-47db-b4b1-a932d1812bd7/migrator/0.log"
Jul 07 19:29:54.849047 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:54.849010    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-gb2zh_b06eb2b9-81ca-47db-b4b1-a932d1812bd7/graceful-termination/0.log"
Jul 07 19:29:56.188522 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:56.188484    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4jx7p_140597b9-f015-41b7-863d-e780e413f042/kube-multus/0.log"
Jul 07 19:29:56.211667 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:56.211609    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ngsq_bab075a0-179b-4731-b520-a770bd0d876c/kube-multus-additional-cni-plugins/0.log"
Jul 07 19:29:56.232612 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:56.232585    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ngsq_bab075a0-179b-4731-b520-a770bd0d876c/egress-router-binary-copy/0.log"
Jul 07 19:29:56.255243 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:56.255226    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ngsq_bab075a0-179b-4731-b520-a770bd0d876c/cni-plugins/0.log"
Jul 07 19:29:56.276082 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:56.276068    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ngsq_bab075a0-179b-4731-b520-a770bd0d876c/bond-cni-plugin/0.log"
Jul 07 19:29:56.298324 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:56.298308    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ngsq_bab075a0-179b-4731-b520-a770bd0d876c/routeoverride-cni/0.log"
Jul 07 19:29:56.321355 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:56.321333    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ngsq_bab075a0-179b-4731-b520-a770bd0d876c/whereabouts-cni-bincopy/0.log"
Jul 07 19:29:56.344527 ip-10-0-142-228 kubenswrapper[2577]: I0707 19:29:56.344500    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ngsq_bab075a0-179b-4731-b520-a770bd0d876c/whereabouts-cni/0.log"