Jul 16 21:50:00.377952 ip-10-0-135-126 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 21:50:00.687166 ip-10-0-135-126 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:50:00.687166 ip-10-0-135-126 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 21:50:00.687166 ip-10-0-135-126 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:50:00.687166 ip-10-0-135-126 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 21:50:00.687166 ip-10-0-135-126 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:50:00.687963 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.687848    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 21:50:00.692689 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692666    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:50:00.692689 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692684    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:50:00.692689 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692689    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:50:00.692689 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692692    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:50:00.692689 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692695    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:50:00.692689 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692698    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692735    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692740    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692743    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692747    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692750    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692753    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692756    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692759    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692762    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692766    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692769    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692771    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692774    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692777    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692779    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692782    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692784    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692787    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692790    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:50:00.692908 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692792    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692794    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692797    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692800    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692803    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692806    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692808    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692811    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692813    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692815    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692818    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692820    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692823    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692825    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692829    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692833    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692837    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692840    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692843    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692846    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:50:00.693385 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692849    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692853    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692857    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692860    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692863    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692866    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692869    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692872    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692874    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692877    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692879    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692882    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692884    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692887    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692889    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692892    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692895    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692897    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692900    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:50:00.693894 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692902    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692905    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692907    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692911    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692914    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692916    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692919    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692922    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692925    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692928    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692930    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692933    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692936    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692939    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692943    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692946    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692948    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692951    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692954    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692957    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:50:00.694387 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692960    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692962    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692965    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692968    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692971    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692973    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692976    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692978    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692981    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692983    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692986    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692988    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692991    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692993    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.692996    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693748    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693756    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693759    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693762    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693766    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:50:00.694881 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693768    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693771    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693775    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693778    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693780    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693783    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693786    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693788    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693791    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693793    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693796    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693799    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693802    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693804    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693807    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693809    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693812    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693814    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693817    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693820    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:50:00.695349 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693822    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693825    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693827    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693830    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693832    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693835    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693837    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693840    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693842    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693845    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693848    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693852    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693855    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693857    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693860    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693863    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693866    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693870    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693873    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:50:00.695884 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693876    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693880    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693883    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693886    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693889    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693891    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693894    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693897    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693900    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693902    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693905    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693908    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693910    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693913    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693916    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693918    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693921    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693923    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693926    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693928    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:50:00.696348 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693931    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693933    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693936    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693938    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693942    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693946    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693949    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693952    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693955    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693958    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693960    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693963    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693965    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693968    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693970    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693973    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693975    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693978    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693980    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:50:00.696859 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693983    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693988    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693992    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693995    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.693998    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694001    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694004    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694007    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694009    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694012    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694015    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694018    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694020    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694023    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694025    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694028    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694414    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694420    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694424    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:50:00.697321 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694427    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694430    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694433    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694436    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694439    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694443    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694446    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694449    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694452    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694455    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694457    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694459    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694462    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694465    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694468    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694471    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694474    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694477    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694480    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694483    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:50:00.697796 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694485    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694488    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694491    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694493    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694496    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694498    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694506    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694509    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694512    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694514    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694517    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694519    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694522    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694525    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694528    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694530    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694533    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694535    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694537    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:50:00.698268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694540    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694542    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694545    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694548    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694550    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694553    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694555    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694558    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694561    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694564    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694567    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694569    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694571    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694574    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694577    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694579    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694582    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694585    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694587    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694590    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:50:00.698736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694592    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694595    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694597    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694600    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694602    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694605    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694607    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694609    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694612    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694633    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694638    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694641    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694644    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694660    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694664    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694667    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694670    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694672    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694675    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694678    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:50:00.699261 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694682    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694685    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694688    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694690    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694693    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694696    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694698    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694701    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694703    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694706    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694708    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694711    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694715    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694718    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694721    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694724    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.694726    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694791    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694798    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694804    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694808    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 21:50:00.699780 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694822    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694826    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694830    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694834    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694837    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694840    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694843    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694847    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694850    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694855    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694858    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694862    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694866    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694869    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694874    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694877    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694880    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694883    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694886    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694890    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694893    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694896    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694900    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694903    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 21:50:00.700272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694907    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694910    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694913    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694916    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694920    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694923    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694926    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694928    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694931    2569 flags.go:64] FLAG: --enable-server="true"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694934    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694939    2569 flags.go:64] FLAG: --event-burst="100"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694942    2569 flags.go:64] FLAG: --event-qps="50"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694945    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694948    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694951    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694954    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694957    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694961    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694964    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694967    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694970    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694974    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694977    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694979    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694982    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 21:50:00.700876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694985    2569 flags.go:64] FLAG: --feature-gates=""
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694989    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694991    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694994    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.694998    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695001    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695004    2569 flags.go:64] FLAG: --help="false"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695006    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-135-126.ec2.internal"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695010    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695012    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695015    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695018    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695021    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695024    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695027    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695030    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695032    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695035    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695038    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695041    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695044    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695046    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695049    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695051    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 21:50:00.701519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695055    2569 flags.go:64] FLAG: --lock-file=""
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695058    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695063    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695066    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695071    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695074    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695077    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695080    2569 flags.go:64] FLAG: --logging-format="text"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695083    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695086    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695089    2569 flags.go:64] FLAG: --manifest-url=""
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695092    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695096    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695099    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695103    2569 flags.go:64] FLAG: --max-pods="110"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695106    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695109    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695112    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695114    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695117    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695120    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695123    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695130    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695133    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695136    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 21:50:00.702118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695139    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695142    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695147    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695150    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695153    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695157    2569 flags.go:64] FLAG: --port="10250"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695160    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695164    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0db05dae8edb1c3e7"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695167    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695170    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695174    2569 flags.go:64] FLAG: --register-node="true"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695177    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695181    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695185    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695188    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695191    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695194    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695197    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695200    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695203    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695206    2569 flags.go:64] FLAG: --runonce="false"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695209    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695211    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695214    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695217    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 21:50:00.702815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695220    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695223    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695226    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695229    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695232    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695235    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695238    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695241    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695244    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695246    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695249    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695254    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695257    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695259    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695265    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695268    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695271    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695277    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695280    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695283    2569 flags.go:64] FLAG: --v="2"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695287    2569 flags.go:64] FLAG: --version="false"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695291    2569 flags.go:64] FLAG: --vmodule=""
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695295    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.695298    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695408    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:50:00.703425 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695411    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695414    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695417    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695420    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695423    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695425    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695428    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695430    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695433    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695435    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695438    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695440    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695442    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695445    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695447    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695450    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695452    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695455    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695457    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695460    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:50:00.704079 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695462    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695466    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695469    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695471    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695475    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695479    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695483    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695486    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695489    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695492    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695496    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695500    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695503    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695505    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695508    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695511    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695514    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695517    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695520    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:50:00.704565 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695523    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695525    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695528    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695531    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695533    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695536    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695538    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695541    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695544    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695546    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695549    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695551    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695554    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695556    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695561    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695565    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695568    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695572    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695575    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:50:00.705127 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695578    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695580    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695583    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695586    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695589    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695591    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695594    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695596    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695599    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695601    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695604    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695606    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695609    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695612    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695629    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695632    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695635    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695637    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695639    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695642    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:50:00.705595 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695644    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695647    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695650    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695652    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695654    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695657    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695660    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695664    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695667    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695669    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695673    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695676    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695680    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695683    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695686    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695688    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695691    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695694    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695696    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:50:00.706092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.695699    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.696156    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.702932    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.702952    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.703500    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.703515    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703578    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703583    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703587    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703590    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703593    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703596    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703599    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703603    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703606    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:50:00.706560 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703609    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703612    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703628    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703633    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703636    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703639    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703642    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703644    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703647    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703649    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703652    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703656    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703660    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703663    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703665    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703668    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703671    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703673    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703676    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:50:00.706971 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703679    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703691    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703693    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703696    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703699    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703701    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703705    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703707    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703710    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703712    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703715    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703717    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703720    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703722    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703733    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703736    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703738    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703742    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703746    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:50:00.707429 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703749    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703752    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703755    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703758    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703760    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703763    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703766    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703769    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703772    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703775    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703778    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703780    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703783    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703786    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703789    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703798    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703801    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703804    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703806    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703809    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:50:00.707953 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703811    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703814    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703817    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703820    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703822    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703825    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703827    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703831    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703834    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703838    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703840    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703843    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703845    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703848    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703850    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703852    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703855    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703857    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703860    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703863    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:50:00.708487 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703865    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703868    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703871    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703873    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703876    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703879    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703881    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703884    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703892    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703895    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703897    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.703900    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.703905    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704046    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704050    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:50:00.709067 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704053    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704056    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704059    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704062    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704064    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704067    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704069    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704072    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704074    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704077    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704080    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704082    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704085    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704088    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704090    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704093    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704096    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704098    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704101    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704103    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:50:00.709438 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704106    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704109    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704111    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704113    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704116    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704118    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704126    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704129    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704132    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704134    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704136    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704139    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704141    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704143    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704146    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704148    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704151    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704153    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704155    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704158    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:50:00.709945 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704161    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704163    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704166    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704168    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704171    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704175    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704179    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704182    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704185    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704188    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704191    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704193    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704196    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704199    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704201    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704204    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704206    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704209    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704211    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704219    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:50:00.710543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704222    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704225    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704227    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704230    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704232    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704235    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704237    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704240    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704242    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704244    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704247    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704250    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704254    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704256    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704259    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704262    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704264    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704267    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704269    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:50:00.711110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704272    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704275    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704277    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704280    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704282    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704285    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704287    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704290    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704292    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704295    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704297    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704299    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704302    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704310    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704313    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704317    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704320    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:50:00.711736 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:00.704322    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:50:00.712267 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.704327    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:50:00.712267 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.704459    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 21:50:00.712267 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.706487    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 21:50:00.712267 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.707576    2569 server.go:1019] "Starting client certificate rotation"
Jul 16 21:50:00.712267 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.707697    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:50:00.712267 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.707749    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:50:00.712267 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.710036    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:50:00.715170 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.715149    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:50:00.723288 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.723270    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 16 21:50:00.725132 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.725116    2569 log.go:25] "Validated CRI v1 image API"
Jul 16 21:50:00.726522 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.726500    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 21:50:00.728513 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.728495    2569 fs.go:135] Filesystem UUIDs: map[2d5d40f3-480e-4893-b895-accbd083217b:/dev/nvme0n1p3 7618ecf7-4512-4b4d-8498-434b2f16621b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 16 21:50:00.728581 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.728513    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 21:50:00.734570 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.734460    2569 manager.go:216] Machine: {Timestamp:2026-07-16 21:50:00.733347519 +0000 UTC m=+0.263890235 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3068109 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24279a2ec108bd02ebaf940b8725fb SystemUUID:ec24279a-2ec1-08bd-02eb-af940b8725fb BootID:8a078c83-3a90-4ff3-b4ca-36998d631a06 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:dd:1d:e2:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:dd:1d:e2:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:83:45:de:b9:f8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 21:50:00.734570 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.734563    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 21:50:00.734693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.734661    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 21:50:00.737107 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.737078    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 21:50:00.737242 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.737109    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 21:50:00.738148 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.738138    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 21:50:00.738181 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.738150    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 21:50:00.738181 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.738159    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:50:00.738659 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.738649    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:50:00.739808 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.739798    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 21:50:00.743489 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.743476    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:50:00.743607 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.743597    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 21:50:00.744141 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.744130    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 21:50:00.744181 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.744152    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 21:50:00.744181 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.744164    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 21:50:00.744181 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.744174    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 16 21:50:00.744339 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.744183    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 21:50:00.744889 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.744867    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:50:00.744990 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.744900    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:50:00.748382 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.748358    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 21:50:00.750027 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.750012    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 21:50:00.750101 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.750042    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 21:50:00.751469 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751457    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 21:50:00.751525 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751473    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 21:50:00.751525 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751480    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 21:50:00.751525 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751487    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 21:50:00.751525 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751500    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 21:50:00.751525 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751508    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 21:50:00.751525 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751516    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 21:50:00.751525 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751523    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 21:50:00.751752 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751533    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 21:50:00.751752 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751541    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 21:50:00.751752 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751550    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 21:50:00.751752 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.751556    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 21:50:00.752106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.752096    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 21:50:00.752106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.752105    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 21:50:00.752495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.752478    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:50:00.755250 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.755236    2569 server.go:1268] "Started kubelet"
Jul 16 21:50:00.755362 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.755306    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 21:50:00.755401 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.755337    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 21:50:00.755439 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.755427    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 21:50:00.756210 ip-10-0-135-126 systemd[1]: Started Kubernetes Kubelet.
Jul 16 21:50:00.756945 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.756929    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 21:50:00.757212 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.757199    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 21:50:00.757847 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.757812    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 21:50:00.757937 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.757906    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 21:50:00.757999 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.757891    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 21:50:00.760036 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.760018    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 21:50:00.763108 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.763094    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 21:50:00.763191 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.763106    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 21:50:00.763766 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.763503    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:00.763766 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.763749    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 21:50:00.763901 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.763779    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 21:50:00.763901 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.763749    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 21:50:00.763993 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.763924    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 21:50:00.763993 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.763943    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 21:50:00.764286 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.764268    2569 factory.go:55] Registering systemd factory
Jul 16 21:50:00.764286 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.764283    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 16 21:50:00.764470 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.764458    2569 factory.go:153] Registering CRI-O factory
Jul 16 21:50:00.764510 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.764472    2569 factory.go:223] Registration of the crio container factory successfully
Jul 16 21:50:00.764539 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.764513    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 21:50:00.764539 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.764530    2569 factory.go:103] Registering Raw factory
Jul 16 21:50:00.764597 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.764547    2569 manager.go:1196] Started watching for new ooms in manager
Jul 16 21:50:00.765123 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.765111    2569 manager.go:349] Starting recovery of all containers
Jul 16 21:50:00.765856 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.765831    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 21:50:00.766386 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.766362    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 21:50:00.766751 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.765882    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-126.ec2.internal.18c2e38dd88de918  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-126.ec2.internal,UID:ip-10-0-135-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-126.ec2.internal,},FirstTimestamp:2026-07-16 21:50:00.75521052 +0000 UTC m=+0.285753237,LastTimestamp:2026-07-16 21:50:00.75521052 +0000 UTC m=+0.285753237,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-126.ec2.internal,}"
Jul 16 21:50:00.786047 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.786011    2569 manager.go:354] Recovery completed
Jul 16 21:50:00.792526 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.792509    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:50:00.794464 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.794434    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:50:00.794521 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.794482    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:50:00.794521 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.794493    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:50:00.795057 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.795041    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 21:50:00.795057 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.795049    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:50:00.795057 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.795056    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 21:50:00.795215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.795074    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:50:00.795774 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.795755    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:50:00.795854 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.795791    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:50:00.795854 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.795811    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:50:00.797224 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.797213    2569 policy_none.go:49] "None policy: Start"
Jul 16 21:50:00.797275 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.797229    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 21:50:00.797275 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.797239    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 21:50:00.799214 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.799202    2569 policy_none.go:47] "Start"
Jul 16 21:50:00.805893 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.805758    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v5c98"
Jul 16 21:50:00.805973 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.805845    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-126.ec2.internal.18c2e38ddae4ee10  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-126.ec2.internal,UID:ip-10-0-135-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-126.ec2.internal,},FirstTimestamp:2026-07-16 21:50:00.794467856 +0000 UTC m=+0.325010581,LastTimestamp:2026-07-16 21:50:00.794467856 +0000 UTC m=+0.325010581,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-126.ec2.internal,}"
Jul 16 21:50:00.811178 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.811159    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v5c98"
Jul 16 21:50:00.816120 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.816052    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-126.ec2.internal.18c2e38ddae539e3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-126.ec2.internal,UID:ip-10-0-135-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-126.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-126.ec2.internal,},FirstTimestamp:2026-07-16 21:50:00.794487267 +0000 UTC m=+0.325029987,LastTimestamp:2026-07-16 21:50:00.794487267 +0000 UTC m=+0.325029987,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-126.ec2.internal,}"
Jul 16 21:50:00.834898 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.834881    2569 manager.go:337] "Starting Device Plugin manager"
Jul 16 21:50:00.834985 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.834922    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 21:50:00.834985 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.834931    2569 server.go:87] "Starting device plugin registration server"
Jul 16 21:50:00.835173 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.835161    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 21:50:00.835207 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.835175    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 21:50:00.835271 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.835255    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 21:50:00.835387 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.835347    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 21:50:00.835387 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.835360    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 21:50:00.835895 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.835876    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 21:50:00.835980 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.835920    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:00.893812 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.893764    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 21:50:00.896018 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.895053    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 21:50:00.896018 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.895109    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 21:50:00.896018 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.895142    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 21:50:00.896018 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.895199    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 21:50:00.897685 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.897667    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:50:00.935902 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.935869    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:50:00.937743 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.937690    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:50:00.937743 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.937725    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:50:00.937743 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.937741    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:50:00.937874 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.937766    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-126.ec2.internal"
Jul 16 21:50:00.946093 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.946069    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-126.ec2.internal"
Jul 16 21:50:00.946093 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.946092    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-126.ec2.internal\": node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:00.960068 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:00.960037    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:00.995530 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.995503    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"]
Jul 16 21:50:00.995652 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.995568    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:50:00.997060 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.997039    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:50:00.997177 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.997072    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:50:00.997177 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.997085    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:50:00.999462 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.999445    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:50:00.999575 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.999560    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:00.999637 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:00.999589    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:50:01.000148 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.000131    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:50:01.000234 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.000162    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:50:01.000234 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.000176    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:50:01.000234 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.000133    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:50:01.000234 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.000229    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:50:01.000420 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.000239    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:50:01.002508 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.002489    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.002598 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.002526    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:50:01.003164 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.003150    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:50:01.003239 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.003171    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:50:01.003239 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.003183    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:50:01.027371 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.027342    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-126.ec2.internal\" not found" node="ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.031746 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.031720    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-126.ec2.internal\" not found" node="ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.060126 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.060092    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:01.065381 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.065360    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17bfdb50676c3bf2669d966884036d13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal\" (UID: \"17bfdb50676c3bf2669d966884036d13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.065455 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.065389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17bfdb50676c3bf2669d966884036d13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal\" (UID: \"17bfdb50676c3bf2669d966884036d13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.065455 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.065413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e512000d9c56b71726f3bdf954e6827-config\") pod \"kube-apiserver-proxy-ip-10-0-135-126.ec2.internal\" (UID: \"2e512000d9c56b71726f3bdf954e6827\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.161110 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.161078    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:01.166424 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.166402    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e512000d9c56b71726f3bdf954e6827-config\") pod \"kube-apiserver-proxy-ip-10-0-135-126.ec2.internal\" (UID: \"2e512000d9c56b71726f3bdf954e6827\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.166474 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.166433    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17bfdb50676c3bf2669d966884036d13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal\" (UID: \"17bfdb50676c3bf2669d966884036d13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.166474 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.166448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17bfdb50676c3bf2669d966884036d13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal\" (UID: \"17bfdb50676c3bf2669d966884036d13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.166542 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.166479    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17bfdb50676c3bf2669d966884036d13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal\" (UID: \"17bfdb50676c3bf2669d966884036d13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.166542 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.166506    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e512000d9c56b71726f3bdf954e6827-config\") pod \"kube-apiserver-proxy-ip-10-0-135-126.ec2.internal\" (UID: \"2e512000d9c56b71726f3bdf954e6827\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.166542 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.166509    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17bfdb50676c3bf2669d966884036d13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal\" (UID: \"17bfdb50676c3bf2669d966884036d13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.261306 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.261275    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:01.330498 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.330455    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.334189 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.334172    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.362305 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.362269    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:01.462845 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.462805    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:01.563344 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.563257    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:01.663781 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:01.663738    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-126.ec2.internal\" not found"
Jul 16 21:50:01.707224 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.707192    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 21:50:01.707671 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.707347    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 21:50:01.758023 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.757993    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:50:01.764072 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.764044    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 21:50:01.764072 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.764061    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.775019 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.774969    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:50:01.776542 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.776523    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal"
Jul 16 21:50:01.777563 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.777546    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:50:01.787103 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.787076    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:50:01.804882 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.804860    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pstkf"
Jul 16 21:50:01.813420 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.813369    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pstkf"
Jul 16 21:50:01.816146 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.816117    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 21:45:00 +0000 UTC" deadline="2028-03-16 13:47:30.554441333 +0000 UTC"
Jul 16 21:50:01.816205 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:01.816146    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14607h57m28.738298499s"
Jul 16 21:50:02.193318 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.193294    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:50:02.236300 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.236272    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:50:02.313280 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:02.313243    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e512000d9c56b71726f3bdf954e6827.slice/crio-5e76f1c29277400c5e85ea7e8b776ffb4bee9be6566924d85651dc06d60fac8d WatchSource:0}: Error finding container 5e76f1c29277400c5e85ea7e8b776ffb4bee9be6566924d85651dc06d60fac8d: Status 404 returned error can't find the container with id 5e76f1c29277400c5e85ea7e8b776ffb4bee9be6566924d85651dc06d60fac8d
Jul 16 21:50:02.313699 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:02.313680    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bfdb50676c3bf2669d966884036d13.slice/crio-d8d0cd86267604450c097f21e2a77356d023534bbd1a367110ba3f89acd970fb WatchSource:0}: Error finding container d8d0cd86267604450c097f21e2a77356d023534bbd1a367110ba3f89acd970fb: Status 404 returned error can't find the container with id d8d0cd86267604450c097f21e2a77356d023534bbd1a367110ba3f89acd970fb
Jul 16 21:50:02.318862 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.318844    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:50:02.745204 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.745171    2569 apiserver.go:52] "Watching apiserver"
Jul 16 21:50:02.753837 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.753817    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 21:50:02.754860 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.754823    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-kk8dt","openshift-dns/node-resolver-7ppr6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal","openshift-multus/multus-xbrj9","openshift-multus/network-metrics-daemon-qvmdv","kube-system/global-pull-secret-syncer-85jhb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg","openshift-image-registry/node-ca-kqz4m","openshift-multus/multus-additional-cni-plugins-htsst","openshift-network-diagnostics/network-check-target-9pgl5","openshift-network-operator/iptables-alerter-z2mrk","openshift-ovn-kubernetes/ovnkube-node-gx7jg","kube-system/konnectivity-agent-fbqr7","kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal"]
Jul 16 21:50:02.758858 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.758833    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.761024 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.761003    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:02.761949 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.761912    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 21:50:02.761949 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.761915    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 21:50:02.761949 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.761946    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 21:50:02.762149 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.761979    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bdhdd\""
Jul 16 21:50:02.762149 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.761982    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 21:50:02.762149 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.761940    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 21:50:02.763282 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.763264    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.763614 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.763595    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 21:50:02.763777 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.763760    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gpdss\""
Jul 16 21:50:02.763847 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.763787    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 21:50:02.765654 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.765623    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.767760 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.767736    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 21:50:02.767927 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.767898    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:02.768020 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.767976    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 21:50:02.768020 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.767972    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:02.768622 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.768605    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jmtt8\""
Jul 16 21:50:02.768916 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.768900    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4gpjd\""
Jul 16 21:50:02.769048 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.769024    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 21:50:02.769326 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.769313    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 21:50:02.770110 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.770095    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.770189 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.770146    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:02.772358 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.772322    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.774491 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.774471    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.775157 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.774660    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-cnibin\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.775248 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-netns\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.775248 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775231    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-cni-bin\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.775349 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775263    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-registration-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.775434 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775292    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-device-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.775485 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775458    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-cnibin\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.775485 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775466    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 21:50:02.775573 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-socket-dir-parent\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.775957 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.775957 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775948    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:50:02.776121 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775978    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-42thw\""
Jul 16 21:50:02.776121 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.775989    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jj8t\" (UniqueName: \"kubernetes.io/projected/d4054768-5b74-4537-80b2-dd8d55c495ff-kube-api-access-8jj8t\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.776121 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-daemon-config\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776121 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-multus-certs\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.776307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776181    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c3842ad-701e-4be3-8855-0f9f2e285c58-konnectivity-ca\") pod \"konnectivity-agent-fbqr7\" (UID: \"3c3842ad-701e-4be3-8855-0f9f2e285c58\") " pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:02.776307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776215    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-kubelet\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776266    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-hostroot\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776475 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776304    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-system-cni-dir\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.776475 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.776475 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-etc-kubernetes\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776475 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776411    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-system-cni-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776475 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-cni-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776503    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-cni-multus\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-conf-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c3842ad-701e-4be3-8855-0f9f2e285c58-agent-certs\") pod \"konnectivity-agent-fbqr7\" (UID: \"3c3842ad-701e-4be3-8855-0f9f2e285c58\") " pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:02.776722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-socket-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.776722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776636    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-os-release\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87e7ab61-d7df-4a4b-87fd-dec52001131a-cni-binary-copy\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776996 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776724    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-k8s-cni-cncf-io\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776996 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bfsn\" (UniqueName: \"kubernetes.io/projected/87e7ab61-d7df-4a4b-87fd-dec52001131a-kube-api-access-7bfsn\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.776996 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.776996 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.776996 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-os-release\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.776996 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776873    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.776996 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-sys-fs\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.776996 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.776944    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf94v\" (UniqueName: \"kubernetes.io/projected/a24188b2-0e54-48eb-a982-41c4dedca9d6-kube-api-access-wf94v\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.778731 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.778710    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:02.779011 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.778781    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:02.779764 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.779745    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 21:50:02.779876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.779851    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 21:50:02.779937 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.779914    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7xjp4\""
Jul 16 21:50:02.779989 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.779957    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 21:50:02.780976 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.780952    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.783352 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.783336    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.785253 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.785232    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:50:02.785339 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.785238    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mhhcn\""
Jul 16 21:50:02.785542 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.785456    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 21:50:02.785770 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.785753    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.786258 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.786243    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 21:50:02.786467 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.786450    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 21:50:02.786526 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.786494    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 21:50:02.786760 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.786744    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 21:50:02.786880 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.786864    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mk8fp\""
Jul 16 21:50:02.786966 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.786953    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 21:50:02.787011 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.786973    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 21:50:02.787065 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.787044    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 21:50:02.789443 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.789424    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 21:50:02.789561 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.789443    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-csbvl\""
Jul 16 21:50:02.789561 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.789502    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 21:50:02.816826 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.816787    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:45:01 +0000 UTC" deadline="2028-02-23 03:49:09.233643138 +0000 UTC"
Jul 16 21:50:02.816826 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.816824    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14069h59m6.416820941s"
Jul 16 21:50:02.865633 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.865585    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 21:50:02.877655 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovnkube-script-lib\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.877745 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/993b5a35-6803-4ee4-9bc8-2df7b42d3491-serviceca\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.877783 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-os-release\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.877783 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.877856 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysconfig\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.877856 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877800    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-os-release\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.877856 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877819    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.877856 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-kubernetes\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.877990 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877871    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-lib-modules\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.877990 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-slash\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.877990 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-env-overrides\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.877990 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877939    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-cnibin\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.877990 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877959    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3d9722-1652-4888-9fca-a110e9241f0d-tmp-dir\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.878176 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.877989    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-multus-certs\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878176 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878017    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c3842ad-701e-4be3-8855-0f9f2e285c58-konnectivity-ca\") pod \"konnectivity-agent-fbqr7\" (UID: \"3c3842ad-701e-4be3-8855-0f9f2e285c58\") " pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:02.878176 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:02.878176 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-hostroot\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878176 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878084    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-multus-certs\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878176 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878099    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjhx\" (UniqueName: \"kubernetes.io/projected/d4c31fe4-73ba-4326-b035-64943224bd76-kube-api-access-xfjhx\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.878176 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878161    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-hostroot\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-node-log\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-run-ovn-kubernetes\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878255    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-dbus\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-etc-kubernetes\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-etc-kubernetes\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878395    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-system-cni-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-conf-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878462    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c3842ad-701e-4be3-8855-0f9f2e285c58-agent-certs\") pod \"konnectivity-agent-fbqr7\" (UID: \"3c3842ad-701e-4be3-8855-0f9f2e285c58\") " pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878482    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-cnibin\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.878495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878496    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-socket-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878508    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-system-cni-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878522    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvgrn\" (UniqueName: \"kubernetes.io/projected/2d3d9722-1652-4888-9fca-a110e9241f0d-kube-api-access-zvgrn\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878526    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-conf-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878611    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-socket-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c31fe4-73ba-4326-b035-64943224bd76-host-slash\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eb363a7-703a-4357-b4f4-cb1094f64603-tmp\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878706    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-kubelet\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878742    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-sys-fs\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878759    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf94v\" (UniqueName: \"kubernetes.io/projected/a24188b2-0e54-48eb-a982-41c4dedca9d6-kube-api-access-wf94v\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878802    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-sys-fs\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-var-lib-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878865    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-cni-netd\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.879106 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/993b5a35-6803-4ee4-9bc8-2df7b42d3491-host\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-cnibin\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-netns\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.878996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-cni-bin\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879023    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-registration-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879028    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-cnibin\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-device-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879102    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-cni-bin\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-systemd\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-tuned\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879160    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-systemd\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879167    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-netns\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879192    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-socket-dir-parent\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-device-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879213    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879222    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.879727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879225    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c3842ad-701e-4be3-8855-0f9f2e285c58-konnectivity-ca\") pod \"konnectivity-agent-fbqr7\" (UID: \"3c3842ad-701e-4be3-8855-0f9f2e285c58\") " pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-registration-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jj8t\" (UniqueName: \"kubernetes.io/projected/d4054768-5b74-4537-80b2-dd8d55c495ff-kube-api-access-8jj8t\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879338    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysctl-conf\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879344    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-socket-dir-parent\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-systemd-units\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-run-netns\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vhps\" (UniqueName: \"kubernetes.io/projected/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-kube-api-access-6vhps\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879406    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d3d9722-1652-4888-9fca-a110e9241f0d-hosts-file\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879450    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-daemon-config\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879503    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-run\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879538    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-sys\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-host\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.880480 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879613    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-kubelet-config\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879678    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqfs\" (UniqueName: \"kubernetes.io/projected/7eb363a7-703a-4357-b4f4-cb1094f64603-kube-api-access-2fqfs\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879705    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-kubelet\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879732    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-system-cni-dir\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879733    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879768    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-kubelet\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879827    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4c31fe4-73ba-4326-b035-64943224bd76-iptables-alerter-script\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-modprobe-d\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879905    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a24188b2-0e54-48eb-a982-41c4dedca9d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879898    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4054768-5b74-4537-80b2-dd8d55c495ff-system-cni-dir\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-var-lib-kubelet\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.879961    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-ovn\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-cni-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880060    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4054768-5b74-4537-80b2-dd8d55c495ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880078    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-cni-multus\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880100    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-log-socket\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880102    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-daemon-config\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880124    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovn-node-metrics-cert\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4c8m\" (UniqueName: \"kubernetes.io/projected/ef73cd15-199a-4b26-8f4f-4f0b860f4670-kube-api-access-m4c8m\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880157    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-var-lib-cni-multus\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4mkn\" (UniqueName: \"kubernetes.io/projected/993b5a35-6803-4ee4-9bc8-2df7b42d3491-kube-api-access-z4mkn\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880191    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-os-release\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880211    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-multus-cni-dir\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87e7ab61-d7df-4a4b-87fd-dec52001131a-cni-binary-copy\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-k8s-cni-cncf-io\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880279    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-os-release\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880301    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87e7ab61-d7df-4a4b-87fd-dec52001131a-host-run-k8s-cni-cncf-io\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bfsn\" (UniqueName: \"kubernetes.io/projected/87e7ab61-d7df-4a4b-87fd-dec52001131a-kube-api-access-7bfsn\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880341    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysctl-d\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880365    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-etc-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovnkube-config\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.880407    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-cni-bin\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.881693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.881370    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87e7ab61-d7df-4a4b-87fd-dec52001131a-cni-binary-copy\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.882839 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.882824    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c3842ad-701e-4be3-8855-0f9f2e285c58-agent-certs\") pod \"konnectivity-agent-fbqr7\" (UID: \"3c3842ad-701e-4be3-8855-0f9f2e285c58\") " pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:02.891773 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.891750    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jj8t\" (UniqueName: \"kubernetes.io/projected/d4054768-5b74-4537-80b2-dd8d55c495ff-kube-api-access-8jj8t\") pod \"multus-additional-cni-plugins-htsst\" (UID: \"d4054768-5b74-4537-80b2-dd8d55c495ff\") " pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:02.891877 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.891808    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bfsn\" (UniqueName: \"kubernetes.io/projected/87e7ab61-d7df-4a4b-87fd-dec52001131a-kube-api-access-7bfsn\") pod \"multus-xbrj9\" (UID: \"87e7ab61-d7df-4a4b-87fd-dec52001131a\") " pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:02.893460 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.893443    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf94v\" (UniqueName: \"kubernetes.io/projected/a24188b2-0e54-48eb-a982-41c4dedca9d6-kube-api-access-wf94v\") pod \"aws-ebs-csi-driver-node-759mg\" (UID: \"a24188b2-0e54-48eb-a982-41c4dedca9d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:02.901056 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.900998    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal" event={"ID":"2e512000d9c56b71726f3bdf954e6827","Type":"ContainerStarted","Data":"5e76f1c29277400c5e85ea7e8b776ffb4bee9be6566924d85651dc06d60fac8d"}
Jul 16 21:50:02.902828 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.902797    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal" event={"ID":"17bfdb50676c3bf2669d966884036d13","Type":"ContainerStarted","Data":"d8d0cd86267604450c097f21e2a77356d023534bbd1a367110ba3f89acd970fb"}
Jul 16 21:50:02.980783 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:02.980783 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980785    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-var-lib-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-cni-netd\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980859    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/993b5a35-6803-4ee4-9bc8-2df7b42d3491-host\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980887    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-systemd\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-tuned\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980922    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-cni-netd\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980932    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-systemd\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980957    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysctl-conf\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980979    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-systemd-units\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.980981    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-var-lib-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981002    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-run-netns\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vhps\" (UniqueName: \"kubernetes.io/projected/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-kube-api-access-6vhps\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d3d9722-1652-4888-9fca-a110e9241f0d-hosts-file\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981076    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-run\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981095    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-sys\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-host\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.981113    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981135    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981163    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-kubelet-config\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.981194    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret podName:d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb nodeName:}" failed. No retries permitted until 2026-07-16 21:50:03.481171258 +0000 UTC m=+3.011713969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret") pod "global-pull-secret-syncer-85jhb" (UID: "d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981215    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-kubelet-config\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqfs\" (UniqueName: \"kubernetes.io/projected/7eb363a7-703a-4357-b4f4-cb1094f64603-kube-api-access-2fqfs\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981267    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d3d9722-1652-4888-9fca-a110e9241f0d-hosts-file\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981269    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4c31fe4-73ba-4326-b035-64943224bd76-iptables-alerter-script\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981296    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-modprobe-d\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981311    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-run\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-var-lib-kubelet\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981381    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-systemd\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.981613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981407    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-ovn\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-log-socket\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981462    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovn-node-metrics-cert\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4c8m\" (UniqueName: \"kubernetes.io/projected/ef73cd15-199a-4b26-8f4f-4f0b860f4670-kube-api-access-m4c8m\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981488    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-run-netns\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981508    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-systemd-units\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4mkn\" (UniqueName: \"kubernetes.io/projected/993b5a35-6803-4ee4-9bc8-2df7b42d3491-kube-api-access-z4mkn\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysctl-conf\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981493    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-systemd\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981534    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/993b5a35-6803-4ee4-9bc8-2df7b42d3491-host\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981557    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-var-lib-kubelet\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981571    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-ovn\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysctl-d\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981577    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-sys\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981585    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-log-socket\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981607    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-run-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981679    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-modprobe-d\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981612    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-host\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.982447 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981733    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysctl-d\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981629    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-etc-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981950    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-etc-openvswitch\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.981976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovnkube-config\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982001    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-cni-bin\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982024    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovnkube-script-lib\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/993b5a35-6803-4ee4-9bc8-2df7b42d3491-serviceca\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysconfig\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982147    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-cni-bin\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982200    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982227    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-sysconfig\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982246    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-kubernetes\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-lib-modules\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4c31fe4-73ba-4326-b035-64943224bd76-iptables-alerter-script\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-slash\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982287    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982332    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-kubernetes\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.983215 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-env-overrides\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982389    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-slash\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982419    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3d9722-1652-4888-9fca-a110e9241f0d-tmp-dir\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982445    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982450    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7eb363a7-703a-4357-b4f4-cb1094f64603-lib-modules\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982472    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjhx\" (UniqueName: \"kubernetes.io/projected/d4c31fe4-73ba-4326-b035-64943224bd76-kube-api-access-xfjhx\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982497    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-node-log\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-run-ovn-kubernetes\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-dbus\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982563    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovnkube-config\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982579    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvgrn\" (UniqueName: \"kubernetes.io/projected/2d3d9722-1652-4888-9fca-a110e9241f0d-kube-api-access-zvgrn\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982587    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovnkube-script-lib\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982606    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c31fe4-73ba-4326-b035-64943224bd76-host-slash\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982621    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-node-log\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eb363a7-703a-4357-b4f4-cb1094f64603-tmp\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982685    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-dbus\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-kubelet\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982696    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/993b5a35-6803-4ee4-9bc8-2df7b42d3491-serviceca\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:02.983813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982716    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-kubelet\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.984706 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982756    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-host-run-ovn-kubernetes\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.984706 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982760    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3d9722-1652-4888-9fca-a110e9241f0d-tmp-dir\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:02.984706 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982765    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-env-overrides\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.984706 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.982805    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c31fe4-73ba-4326-b035-64943224bd76-host-slash\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:02.984706 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.982903    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:02.984706 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.982963    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs podName:ef73cd15-199a-4b26-8f4f-4f0b860f4670 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:03.482946062 +0000 UTC m=+3.013488771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs") pod "network-metrics-daemon-qvmdv" (UID: "ef73cd15-199a-4b26-8f4f-4f0b860f4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:02.985065 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.985041    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7eb363a7-703a-4357-b4f4-cb1094f64603-etc-tuned\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.985144 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.985083    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eb363a7-703a-4357-b4f4-cb1094f64603-tmp\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.985970 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.985946    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-ovn-node-metrics-cert\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.988659 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.988615    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:50:02.988659 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.988654    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:50:02.988806 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.988667    2569 projected.go:196] Error preparing data for projected volume kube-api-access-qzg9j for pod openshift-network-diagnostics/network-check-target-9pgl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:02.988806 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:02.988736    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j podName:a01e0fa6-5fe0-46b0-b942-85ef83149e3b nodeName:}" failed. No retries permitted until 2026-07-16 21:50:03.488719428 +0000 UTC m=+3.019262148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qzg9j" (UniqueName: "kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j") pod "network-check-target-9pgl5" (UID: "a01e0fa6-5fe0-46b0-b942-85ef83149e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:02.995124 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.995055    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqfs\" (UniqueName: \"kubernetes.io/projected/7eb363a7-703a-4357-b4f4-cb1094f64603-kube-api-access-2fqfs\") pod \"tuned-kk8dt\" (UID: \"7eb363a7-703a-4357-b4f4-cb1094f64603\") " pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:02.995618 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.995560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4c8m\" (UniqueName: \"kubernetes.io/projected/ef73cd15-199a-4b26-8f4f-4f0b860f4670-kube-api-access-m4c8m\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:02.997808 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.997765    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vhps\" (UniqueName: \"kubernetes.io/projected/0010f8ed-8fee-46fe-ac2e-bbb1579aa181-kube-api-access-6vhps\") pod \"ovnkube-node-gx7jg\" (UID: \"0010f8ed-8fee-46fe-ac2e-bbb1579aa181\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:02.999263 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:02.999242    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4mkn\" (UniqueName: \"kubernetes.io/projected/993b5a35-6803-4ee4-9bc8-2df7b42d3491-kube-api-access-z4mkn\") pod \"node-ca-kqz4m\" (UID: \"993b5a35-6803-4ee4-9bc8-2df7b42d3491\") " pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:03.001825 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.001801    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvgrn\" (UniqueName: \"kubernetes.io/projected/2d3d9722-1652-4888-9fca-a110e9241f0d-kube-api-access-zvgrn\") pod \"node-resolver-7ppr6\" (UID: \"2d3d9722-1652-4888-9fca-a110e9241f0d\") " pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:03.003445 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.003400    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjhx\" (UniqueName: \"kubernetes.io/projected/d4c31fe4-73ba-4326-b035-64943224bd76-kube-api-access-xfjhx\") pod \"iptables-alerter-z2mrk\" (UID: \"d4c31fe4-73ba-4326-b035-64943224bd76\") " pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:03.068850 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.068814    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htsst"
Jul 16 21:50:03.074432 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.074408    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:03.081402 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.081367    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4054768_5b74_4537_80b2_dd8d55c495ff.slice/crio-1d7ce4370499c47606379b736cde61792b39b3c05654fdf8f5551f34e4812498 WatchSource:0}: Error finding container 1d7ce4370499c47606379b736cde61792b39b3c05654fdf8f5551f34e4812498: Status 404 returned error can't find the container with id 1d7ce4370499c47606379b736cde61792b39b3c05654fdf8f5551f34e4812498
Jul 16 21:50:03.083545 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.083520    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg"
Jul 16 21:50:03.088622 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.088591    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c3842ad_701e_4be3_8855_0f9f2e285c58.slice/crio-64a10346c33ed457a866a18b4dc8e2fd1850aac3446815ec84207640b0da6ddd WatchSource:0}: Error finding container 64a10346c33ed457a866a18b4dc8e2fd1850aac3446815ec84207640b0da6ddd: Status 404 returned error can't find the container with id 64a10346c33ed457a866a18b4dc8e2fd1850aac3446815ec84207640b0da6ddd
Jul 16 21:50:03.089508 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.089485    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xbrj9"
Jul 16 21:50:03.095543 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.095385    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk8dt"
Jul 16 21:50:03.095543 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.095487    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24188b2_0e54_48eb_a982_41c4dedca9d6.slice/crio-5480a9c368c5973c771e0d0325e3780f9fff13e0de281fc07275948e6f696bd3 WatchSource:0}: Error finding container 5480a9c368c5973c771e0d0325e3780f9fff13e0de281fc07275948e6f696bd3: Status 404 returned error can't find the container with id 5480a9c368c5973c771e0d0325e3780f9fff13e0de281fc07275948e6f696bd3
Jul 16 21:50:03.100472 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.100268    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqz4m"
Jul 16 21:50:03.101260 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.101231    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e7ab61_d7df_4a4b_87fd_dec52001131a.slice/crio-374edf6a548b0e02a64aaf9b4ce89b0c65fae8d063b443a5b763931a4bbcea53 WatchSource:0}: Error finding container 374edf6a548b0e02a64aaf9b4ce89b0c65fae8d063b443a5b763931a4bbcea53: Status 404 returned error can't find the container with id 374edf6a548b0e02a64aaf9b4ce89b0c65fae8d063b443a5b763931a4bbcea53
Jul 16 21:50:03.106119 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.106094    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb363a7_703a_4357_b4f4_cb1094f64603.slice/crio-7b9128918bff46dc4621957d4c93c4284e4a7bfbdc5647e200488a3f8e8413db WatchSource:0}: Error finding container 7b9128918bff46dc4621957d4c93c4284e4a7bfbdc5647e200488a3f8e8413db: Status 404 returned error can't find the container with id 7b9128918bff46dc4621957d4c93c4284e4a7bfbdc5647e200488a3f8e8413db
Jul 16 21:50:03.106632 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.106599    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z2mrk"
Jul 16 21:50:03.111353 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.111328    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993b5a35_6803_4ee4_9bc8_2df7b42d3491.slice/crio-7daaff2977cbdd6e756e8d9e1a67323a563ac49e4340156eb5f409764d84d9b5 WatchSource:0}: Error finding container 7daaff2977cbdd6e756e8d9e1a67323a563ac49e4340156eb5f409764d84d9b5: Status 404 returned error can't find the container with id 7daaff2977cbdd6e756e8d9e1a67323a563ac49e4340156eb5f409764d84d9b5
Jul 16 21:50:03.112564 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.112542    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:03.113105 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.113086    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:50:03.118099 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.118076    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7ppr6"
Jul 16 21:50:03.119268 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.119223    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c31fe4_73ba_4326_b035_64943224bd76.slice/crio-d44fb39e620f339d364b91bfd0eae3cb96dab6029b3dc2fbd5bad0949b27c171 WatchSource:0}: Error finding container d44fb39e620f339d364b91bfd0eae3cb96dab6029b3dc2fbd5bad0949b27c171: Status 404 returned error can't find the container with id d44fb39e620f339d364b91bfd0eae3cb96dab6029b3dc2fbd5bad0949b27c171
Jul 16 21:50:03.124171 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.124108    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0010f8ed_8fee_46fe_ac2e_bbb1579aa181.slice/crio-da873de110b621934606bfe5a987ca989e2c6b6d577a5b18d219ae40fc980944 WatchSource:0}: Error finding container da873de110b621934606bfe5a987ca989e2c6b6d577a5b18d219ae40fc980944: Status 404 returned error can't find the container with id da873de110b621934606bfe5a987ca989e2c6b6d577a5b18d219ae40fc980944
Jul 16 21:50:03.131092 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:03.131062    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3d9722_1652_4888_9fca_a110e9241f0d.slice/crio-8c0c0b84af4daf8c8cab969c382c05f270fb1fb70c001c533c26c7f94b158f53 WatchSource:0}: Error finding container 8c0c0b84af4daf8c8cab969c382c05f270fb1fb70c001c533c26c7f94b158f53: Status 404 returned error can't find the container with id 8c0c0b84af4daf8c8cab969c382c05f270fb1fb70c001c533c26c7f94b158f53
Jul 16 21:50:03.485477 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.485434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:03.485690 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.485490    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:03.485690 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:03.485600    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:03.485690 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:03.485600    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:03.485690 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:03.485679    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret podName:d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb nodeName:}" failed. No retries permitted until 2026-07-16 21:50:04.485660911 +0000 UTC m=+4.016203633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret") pod "global-pull-secret-syncer-85jhb" (UID: "d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:03.485876 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:03.485699    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs podName:ef73cd15-199a-4b26-8f4f-4f0b860f4670 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:04.485690442 +0000 UTC m=+4.016233147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs") pod "network-metrics-daemon-qvmdv" (UID: "ef73cd15-199a-4b26-8f4f-4f0b860f4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:03.586254 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.586208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:03.586427 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:03.586391    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:50:03.586427 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:03.586418    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:50:03.586525 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:03.586432    2569 projected.go:196] Error preparing data for projected volume kube-api-access-qzg9j for pod openshift-network-diagnostics/network-check-target-9pgl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:03.586525 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:03.586501    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j podName:a01e0fa6-5fe0-46b0-b942-85ef83149e3b nodeName:}" failed. No retries permitted until 2026-07-16 21:50:04.586482858 +0000 UTC m=+4.117025583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzg9j" (UniqueName: "kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j") pod "network-check-target-9pgl5" (UID: "a01e0fa6-5fe0-46b0-b942-85ef83149e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:03.817444 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.817301    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:45:01 +0000 UTC" deadline="2028-01-17 17:34:19.931656772 +0000 UTC"
Jul 16 21:50:03.817444 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.817366    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13195h44m16.114295185s"
Jul 16 21:50:03.906800 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.906751    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7ppr6" event={"ID":"2d3d9722-1652-4888-9fca-a110e9241f0d","Type":"ContainerStarted","Data":"8c0c0b84af4daf8c8cab969c382c05f270fb1fb70c001c533c26c7f94b158f53"}
Jul 16 21:50:03.908692 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.908660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"da873de110b621934606bfe5a987ca989e2c6b6d577a5b18d219ae40fc980944"}
Jul 16 21:50:03.911758 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.911730    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z2mrk" event={"ID":"d4c31fe4-73ba-4326-b035-64943224bd76","Type":"ContainerStarted","Data":"d44fb39e620f339d364b91bfd0eae3cb96dab6029b3dc2fbd5bad0949b27c171"}
Jul 16 21:50:03.913237 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.913211    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqz4m" event={"ID":"993b5a35-6803-4ee4-9bc8-2df7b42d3491","Type":"ContainerStarted","Data":"7daaff2977cbdd6e756e8d9e1a67323a563ac49e4340156eb5f409764d84d9b5"}
Jul 16 21:50:03.914848 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.914824    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk8dt" event={"ID":"7eb363a7-703a-4357-b4f4-cb1094f64603","Type":"ContainerStarted","Data":"7b9128918bff46dc4621957d4c93c4284e4a7bfbdc5647e200488a3f8e8413db"}
Jul 16 21:50:03.916849 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.916826    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xbrj9" event={"ID":"87e7ab61-d7df-4a4b-87fd-dec52001131a","Type":"ContainerStarted","Data":"374edf6a548b0e02a64aaf9b4ce89b0c65fae8d063b443a5b763931a4bbcea53"}
Jul 16 21:50:03.918455 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.918432    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg" event={"ID":"a24188b2-0e54-48eb-a982-41c4dedca9d6","Type":"ContainerStarted","Data":"5480a9c368c5973c771e0d0325e3780f9fff13e0de281fc07275948e6f696bd3"}
Jul 16 21:50:03.921313 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.921287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fbqr7" event={"ID":"3c3842ad-701e-4be3-8855-0f9f2e285c58","Type":"ContainerStarted","Data":"64a10346c33ed457a866a18b4dc8e2fd1850aac3446815ec84207640b0da6ddd"}
Jul 16 21:50:03.922663 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:03.922641    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htsst" event={"ID":"d4054768-5b74-4537-80b2-dd8d55c495ff","Type":"ContainerStarted","Data":"1d7ce4370499c47606379b736cde61792b39b3c05654fdf8f5551f34e4812498"}
Jul 16 21:50:04.493421 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:04.492564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:04.493421 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:04.492673    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:04.493421 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.492841    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:04.493421 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.492907    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs podName:ef73cd15-199a-4b26-8f4f-4f0b860f4670 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:06.492888269 +0000 UTC m=+6.023430988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs") pod "network-metrics-daemon-qvmdv" (UID: "ef73cd15-199a-4b26-8f4f-4f0b860f4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:04.493421 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.493330    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:04.493421 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.493381    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret podName:d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb nodeName:}" failed. No retries permitted until 2026-07-16 21:50:06.493365907 +0000 UTC m=+6.023908613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret") pod "global-pull-secret-syncer-85jhb" (UID: "d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:04.593893 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:04.593853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:04.594086 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.594036    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:50:04.594086 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.594056    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:50:04.594086 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.594068    2569 projected.go:196] Error preparing data for projected volume kube-api-access-qzg9j for pod openshift-network-diagnostics/network-check-target-9pgl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:04.594236 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.594126    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j podName:a01e0fa6-5fe0-46b0-b942-85ef83149e3b nodeName:}" failed. No retries permitted until 2026-07-16 21:50:06.594108472 +0000 UTC m=+6.124651182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzg9j" (UniqueName: "kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j") pod "network-check-target-9pgl5" (UID: "a01e0fa6-5fe0-46b0-b942-85ef83149e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:04.896260 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:04.895971    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:04.896853 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.896324    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:04.896853 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:04.896013    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:04.896853 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.896432    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:04.896853 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:04.895979    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:04.896853 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:04.896525    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:04.930342 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:04.929553    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal" event={"ID":"2e512000d9c56b71726f3bdf954e6827","Type":"ContainerStarted","Data":"4df2528aa7ce8ee98ced426d5eaf994bf16de1cbbcd80f8ab76ee23fafb4d720"}
Jul 16 21:50:06.511873 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:06.511024    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:06.511873 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:06.511104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:06.511873 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.511236    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:06.511873 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.511302    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs podName:ef73cd15-199a-4b26-8f4f-4f0b860f4670 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:10.511282458 +0000 UTC m=+10.041825165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs") pod "network-metrics-daemon-qvmdv" (UID: "ef73cd15-199a-4b26-8f4f-4f0b860f4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:06.511873 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.511788    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:06.511873 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.511846    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret podName:d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb nodeName:}" failed. No retries permitted until 2026-07-16 21:50:10.511830533 +0000 UTC m=+10.042373240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret") pod "global-pull-secret-syncer-85jhb" (UID: "d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:06.612390 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:06.611767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:06.612390 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.611958    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:50:06.612390 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.611978    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:50:06.612390 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.611990    2569 projected.go:196] Error preparing data for projected volume kube-api-access-qzg9j for pod openshift-network-diagnostics/network-check-target-9pgl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:06.612390 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.612053    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j podName:a01e0fa6-5fe0-46b0-b942-85ef83149e3b nodeName:}" failed. No retries permitted until 2026-07-16 21:50:10.612033175 +0000 UTC m=+10.142575883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzg9j" (UniqueName: "kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j") pod "network-check-target-9pgl5" (UID: "a01e0fa6-5fe0-46b0-b942-85ef83149e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:06.896908 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:06.896350    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:06.896908 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:06.896378    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:06.896908 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.896491    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:06.896908 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:06.896556    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:06.896908 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.896642    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:06.896908 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:06.896756    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:08.895954 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:08.895912    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:08.896460 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:08.896057    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:08.896460 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:08.896126    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:08.896460 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:08.896230    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:08.896460 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:08.896385    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:08.896669 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:08.896514    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:10.547430 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:10.547394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:10.547913 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:10.547466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:10.547913 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.547578    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:10.547913 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.547661    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs podName:ef73cd15-199a-4b26-8f4f-4f0b860f4670 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:18.547638182 +0000 UTC m=+18.078180902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs") pod "network-metrics-daemon-qvmdv" (UID: "ef73cd15-199a-4b26-8f4f-4f0b860f4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:10.547913 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.547578    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:10.548138 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.547959    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret podName:d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb nodeName:}" failed. No retries permitted until 2026-07-16 21:50:18.547940752 +0000 UTC m=+18.078483472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret") pod "global-pull-secret-syncer-85jhb" (UID: "d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:10.648991 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:10.648597    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:10.648991 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.648790    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:50:10.648991 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.648808    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:50:10.648991 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.648821    2569 projected.go:196] Error preparing data for projected volume kube-api-access-qzg9j for pod openshift-network-diagnostics/network-check-target-9pgl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:10.648991 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.648876    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j podName:a01e0fa6-5fe0-46b0-b942-85ef83149e3b nodeName:}" failed. No retries permitted until 2026-07-16 21:50:18.648856915 +0000 UTC m=+18.179399659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzg9j" (UniqueName: "kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j") pod "network-check-target-9pgl5" (UID: "a01e0fa6-5fe0-46b0-b942-85ef83149e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:10.897242 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:10.897152    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:10.897418 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.897274    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:10.897777 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:10.897554    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:10.897777 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:10.897686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:10.897777 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.897772    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:10.898005 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:10.897809    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:12.895518 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:12.895445    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:12.895518 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:12.895467    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:12.896058 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:12.895561    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:12.896058 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:12.895774    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:12.896058 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:12.895871    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:12.896058 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:12.895955    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:14.895660 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:14.895474    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:14.895660 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:14.895506    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:14.895660 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:14.895474    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:14.895660 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:14.895642    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:14.896155 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:14.896026    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:14.896155 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:14.896078    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:16.896206 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:16.896170    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:16.896639 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:16.896170    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:16.896639 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:16.896302    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:16.896639 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:16.896170    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:16.896639 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:16.896431    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:16.896639 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:16.896563    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:18.611659 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:18.611598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:18.612147 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:18.611704    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:18.612147 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.611751    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:18.612147 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.611824    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs podName:ef73cd15-199a-4b26-8f4f-4f0b860f4670 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:34.611804322 +0000 UTC m=+34.142347028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs") pod "network-metrics-daemon-qvmdv" (UID: "ef73cd15-199a-4b26-8f4f-4f0b860f4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:18.612147 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.611866    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:18.612147 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.611943    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret podName:d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb nodeName:}" failed. No retries permitted until 2026-07-16 21:50:34.611921929 +0000 UTC m=+34.142464645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret") pod "global-pull-secret-syncer-85jhb" (UID: "d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:18.713090 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:18.713048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:18.713314 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.713244    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:50:18.713314 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.713287    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:50:18.713314 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.713300    2569 projected.go:196] Error preparing data for projected volume kube-api-access-qzg9j for pod openshift-network-diagnostics/network-check-target-9pgl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:18.713468 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.713372    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j podName:a01e0fa6-5fe0-46b0-b942-85ef83149e3b nodeName:}" failed. No retries permitted until 2026-07-16 21:50:34.713352163 +0000 UTC m=+34.243894887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzg9j" (UniqueName: "kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j") pod "network-check-target-9pgl5" (UID: "a01e0fa6-5fe0-46b0-b942-85ef83149e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:18.896398 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:18.896360    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:18.896398 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:18.896382    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:18.896632 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.896504    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:18.896632 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:18.896530    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:18.896716 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.896655    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:18.896716 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:18.896699    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:20.896899 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:20.896860    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:20.897352 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:20.896971    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:20.897352 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:20.896981    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:20.897352 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:20.897051    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:20.897352 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:20.897075    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:20.897352 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:20.897144    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:22.895793 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:22.895757    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:22.896258 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:22.895768    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:22.896258 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:22.895858    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:22.896258 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:22.895870    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:22.896258 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:22.895977    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:22.896258 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:22.896068    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:23.968540 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.968318    2569 generic.go:356] "Generic (PLEG): container finished" podID="17bfdb50676c3bf2669d966884036d13" containerID="c6b6a6efa6c4954c24689f1949320651eb10c9e2e47f2c60140a787cf00864b1" exitCode=0
Jul 16 21:50:23.969497 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.968398    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal" event={"ID":"17bfdb50676c3bf2669d966884036d13","Type":"ContainerDied","Data":"c6b6a6efa6c4954c24689f1949320651eb10c9e2e47f2c60140a787cf00864b1"}
Jul 16 21:50:23.970344 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.970309    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7ppr6" event={"ID":"2d3d9722-1652-4888-9fca-a110e9241f0d","Type":"ContainerStarted","Data":"79704c9801ec672a9cfa57a41332f47f073be03555d1e52528b12eac036d084a"}
Jul 16 21:50:23.973921 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.973893    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"a2c30662215b18d40b56ccb31c25a0d61f6b6be47f6dde98ea9c0fb4c85b47e7"}
Jul 16 21:50:23.974049 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.973965    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"6ad9946aa73526696eafb12f8eb4ceafc98ea86d330669267f86b408f29d3498"}
Jul 16 21:50:23.974049 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.974016    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"7b235fcdbd8ad72afbf1bd4a259491dec16af35e076f01c266a85b754c205413"}
Jul 16 21:50:23.974165 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.974054    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"fc91c281bf82bbb61177a30e888e81139353c5f826546fac8b30a57c0242e792"}
Jul 16 21:50:23.974165 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.974086    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"2bc9e5d2f93feaa06a2372a4fbf971743ba813a9fb50849bfab95572a302da95"}
Jul 16 21:50:23.974165 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.974124    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"50d686da3c8ae71c4089a7ad9e4eb7c50344a9d34718fbb7238b3c96d6996189"}
Jul 16 21:50:23.975514 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.975484    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqz4m" event={"ID":"993b5a35-6803-4ee4-9bc8-2df7b42d3491","Type":"ContainerStarted","Data":"e6538703fbc453f461ff56d292876ddc68ffb236d522c01e6d6af045bde41a35"}
Jul 16 21:50:23.977015 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.976991    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk8dt" event={"ID":"7eb363a7-703a-4357-b4f4-cb1094f64603","Type":"ContainerStarted","Data":"a84eefed0bccdc397b74acf3f08c772f6ae56cbb4d9c1791e78b902e1027a4db"}
Jul 16 21:50:23.978598 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.978568    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xbrj9" event={"ID":"87e7ab61-d7df-4a4b-87fd-dec52001131a","Type":"ContainerStarted","Data":"a85cf085bdcdb19386e31b1f88ec93a6784cf748963758c9bc609d054c810c65"}
Jul 16 21:50:23.980178 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.980153    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg" event={"ID":"a24188b2-0e54-48eb-a982-41c4dedca9d6","Type":"ContainerStarted","Data":"a6c11222211479d39d753369b14874b62bb9647362ef91d38998f074a0aa1561"}
Jul 16 21:50:23.981519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.981496    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fbqr7" event={"ID":"3c3842ad-701e-4be3-8855-0f9f2e285c58","Type":"ContainerStarted","Data":"f34b16ef400a83ad6333a047ea6b49a5a541b9470e11fd9ffd5204d63b589f78"}
Jul 16 21:50:23.983051 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.983026    2569 generic.go:356] "Generic (PLEG): container finished" podID="d4054768-5b74-4537-80b2-dd8d55c495ff" containerID="29e15d6168158655ad243ed745f54475be25b2c3d00b5b6e90e13b6be7cf6e90" exitCode=0
Jul 16 21:50:23.983144 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.983064    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htsst" event={"ID":"d4054768-5b74-4537-80b2-dd8d55c495ff","Type":"ContainerDied","Data":"29e15d6168158655ad243ed745f54475be25b2c3d00b5b6e90e13b6be7cf6e90"}
Jul 16 21:50:23.989881 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:23.989826    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-126.ec2.internal" podStartSLOduration=22.989806782 podStartE2EDuration="22.989806782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:04.947057533 +0000 UTC m=+4.477600275" watchObservedRunningTime="2026-07-16 21:50:23.989806782 +0000 UTC m=+23.520349510"
Jul 16 21:50:24.011912 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.011854    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7ppr6" podStartSLOduration=3.181906242 podStartE2EDuration="23.01183155s" totalImagesPullingTime="19.829925308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:24.010956172 +0000 UTC m=+23.541498900" watchObservedRunningTime="2026-07-16 21:50:24.01183155 +0000 UTC m=+23.542374281"
Jul 16 21:50:24.057734 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.057522    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kk8dt" podStartSLOduration=3.1866417240000002 podStartE2EDuration="23.057504438s" totalImagesPullingTime="19.870862714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:24.057389366 +0000 UTC m=+23.587932096" watchObservedRunningTime="2026-07-16 21:50:24.057504438 +0000 UTC m=+23.588047167"
Jul 16 21:50:24.074129 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.074065    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kqz4m" podStartSLOduration=3.178431278 podStartE2EDuration="23.074041987s" totalImagesPullingTime="19.895610709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:24.073758314 +0000 UTC m=+23.604301040" watchObservedRunningTime="2026-07-16 21:50:24.074041987 +0000 UTC m=+23.604584715"
Jul 16 21:50:24.093451 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.093407    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xbrj9" podStartSLOduration=3.184687845 podStartE2EDuration="23.093391838s" totalImagesPullingTime="19.908703993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:24.09304212 +0000 UTC m=+23.623584846" watchObservedRunningTime="2026-07-16 21:50:24.093391838 +0000 UTC m=+23.623934597"
Jul 16 21:50:24.129324 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.129271    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fbqr7" podStartSLOduration=4.210912218 podStartE2EDuration="24.129256822s" totalImagesPullingTime="19.918344604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:24.129060962 +0000 UTC m=+23.659603689" watchObservedRunningTime="2026-07-16 21:50:24.129256822 +0000 UTC m=+23.659799549"
Jul 16 21:50:24.651135 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.651100    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 21:50:24.817052 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.817009    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:24.817712 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.817695    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:24.847373 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.847192    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T21:50:24.651125571Z","UUID":"0d1c1d6b-c67a-46fb-9902-644c8f6f786e","Handler":null,"Name":"","Endpoint":""}
Jul 16 21:50:24.849044 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.849013    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 21:50:24.849168 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.849065    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 21:50:24.896072 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.895990    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:24.896072 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.895990    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:24.896294 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.896116    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:24.896294 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:24.896117    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:24.896294 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:24.896239    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:24.896432 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:24.896328    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:24.988131 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.988072    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal" event={"ID":"17bfdb50676c3bf2669d966884036d13","Type":"ContainerStarted","Data":"5aacca61829969f9af4fe03341cb50b1b69245e300fa67732376f7cc58ce6f09"}
Jul 16 21:50:24.989693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.989669    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z2mrk" event={"ID":"d4c31fe4-73ba-4326-b035-64943224bd76","Type":"ContainerStarted","Data":"a707db4454680fd92732d5c7f63f3ba9a6c9ce47097aae5286c4a6ea38635d15"}
Jul 16 21:50:24.991868 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.991838    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg" event={"ID":"a24188b2-0e54-48eb-a982-41c4dedca9d6","Type":"ContainerStarted","Data":"d734a6a3c4a91de36b4be9b4a7f0b8ed05bb6fbc6fcf6f08691d64077b2ce1c2"}
Jul 16 21:50:24.992129 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.992062    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:24.992684 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:24.992671    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fbqr7"
Jul 16 21:50:25.024202 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:25.024143    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-126.ec2.internal" podStartSLOduration=24.024119339 podStartE2EDuration="24.024119339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:25.006852458 +0000 UTC m=+24.537395196" watchObservedRunningTime="2026-07-16 21:50:25.024119339 +0000 UTC m=+24.554662067"
Jul 16 21:50:25.024793 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:25.024754    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z2mrk" podStartSLOduration=4.13513321 podStartE2EDuration="24.024741618s" totalImagesPullingTime="19.889608408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:25.023990736 +0000 UTC m=+24.554533464" watchObservedRunningTime="2026-07-16 21:50:25.024741618 +0000 UTC m=+24.555284347"
Jul 16 21:50:25.784799 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:25.784764    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:26.002973 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.002838    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"0631a1d7ac3fcb9cece6d0bc2781e66fe4efdb64fcf3f313b8b09c2f19df7267"}
Jul 16 21:50:26.004326 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.004291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:26.006727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.006652    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg" event={"ID":"a24188b2-0e54-48eb-a982-41c4dedca9d6","Type":"ContainerStarted","Data":"177e5e08d0916fae4fb626271f9a667079789b89be2dbdb3f8bc07ec354f1548"}
Jul 16 21:50:26.039727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.039666    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-759mg" podStartSLOduration=3.043077306 podStartE2EDuration="25.039645288s" totalImagesPullingTime="21.996567982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:26.03789995 +0000 UTC m=+25.568442678" watchObservedRunningTime="2026-07-16 21:50:26.039645288 +0000 UTC m=+25.570188014"
Jul 16 21:50:26.162132 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.162044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:26.262599 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.262560    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:26.895993 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.895959    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:26.896199 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.896013    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:26.896199 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:26.895967    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:26.896199 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:26.896097    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:26.896484 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:26.896302    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:26.896484 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:26.896346    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:28.893273 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:28.893114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:28.896075 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:28.896059    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:28.896185 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:28.896082    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:28.896185 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:28.896149    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:28.896185 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:28.896060    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:28.896301 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:28.896274    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:28.896398 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:28.896376    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:28.993440 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:28.993414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:29.016178 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:29.016144    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" event={"ID":"0010f8ed-8fee-46fe-ac2e-bbb1579aa181","Type":"ContainerStarted","Data":"c4bb3eeaf3fbe411b893c771e2e0b6d7df959fff6dc94dccea515028a2cc9335"}
Jul 16 21:50:29.016460 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:29.016445    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:29.016531 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:29.016518    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:29.017870 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:29.017834    2569 generic.go:356] "Generic (PLEG): container finished" podID="d4054768-5b74-4537-80b2-dd8d55c495ff" containerID="e0d691dcdabc9ff73eb2c822cd10084db86e3c266f644355c9d66b16db812d5e" exitCode=0
Jul 16 21:50:29.017870 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:29.017869    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htsst" event={"ID":"d4054768-5b74-4537-80b2-dd8d55c495ff","Type":"ContainerDied","Data":"e0d691dcdabc9ff73eb2c822cd10084db86e3c266f644355c9d66b16db812d5e"}
Jul 16 21:50:29.032868 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:29.032844    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:29.049962 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:29.049909    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg" podStartSLOduration=8.029480836 podStartE2EDuration="28.049894314s" totalImagesPullingTime="20.020413478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:29.049530134 +0000 UTC m=+28.580072861" watchObservedRunningTime="2026-07-16 21:50:29.049894314 +0000 UTC m=+28.580437040"
Jul 16 21:50:29.971180 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:29.971138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:30.020605 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.020578    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:30.035400 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.035375    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:50:30.068495 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.068339    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:30.242294 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.242186    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvmdv"]
Jul 16 21:50:30.242454 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.242335    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:30.242516 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:30.242458    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:30.246276 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.246237    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-85jhb"]
Jul 16 21:50:30.246425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.246374    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:30.246503 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:30.246481    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:30.247037 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.247016    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pgl5"]
Jul 16 21:50:30.247109 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:30.247099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:30.247196 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:30.247177    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:31.024594 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:31.024559    2569 generic.go:356] "Generic (PLEG): container finished" podID="d4054768-5b74-4537-80b2-dd8d55c495ff" containerID="98974f1b1b8efb8956f7178a826f9559aa5c0d12c381df7ff1c8166008203f62" exitCode=0
Jul 16 21:50:31.024994 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:31.024660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htsst" event={"ID":"d4054768-5b74-4537-80b2-dd8d55c495ff","Type":"ContainerDied","Data":"98974f1b1b8efb8956f7178a826f9559aa5c0d12c381df7ff1c8166008203f62"}
Jul 16 21:50:31.896060 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:31.896030    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:31.896223 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:31.896126    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:31.896223 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:31.896132    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:31.896223 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:31.896136    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:31.896223 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:31.896204    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:31.896354 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:31.896290    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:32.681510 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:32.681477    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:32.761877 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:32.761843    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:33.031917 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:33.031882    2569 generic.go:356] "Generic (PLEG): container finished" podID="d4054768-5b74-4537-80b2-dd8d55c495ff" containerID="7599bda8b28ff849fed2c0f0ed9079ecf6ae91909a9e4b28f09a066ca4245d43" exitCode=0
Jul 16 21:50:33.032085 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:33.031939    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htsst" event={"ID":"d4054768-5b74-4537-80b2-dd8d55c495ff","Type":"ContainerDied","Data":"7599bda8b28ff849fed2c0f0ed9079ecf6ae91909a9e4b28f09a066ca4245d43"}
Jul 16 21:50:33.895803 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:33.895763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:33.896186 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:33.895763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:33.896186 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:33.895883    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:33.896186 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:33.895763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:33.896186 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:33.895948    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:33.896186 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:33.896039    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:34.623118 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:34.623076    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:34.623311 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:34.623169    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:34.623311 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:34.623253    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:34.623311 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:34.623280    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:34.623469 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:34.623334    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret podName:d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb nodeName:}" failed. No retries permitted until 2026-07-16 21:51:06.623314414 +0000 UTC m=+66.153857134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret") pod "global-pull-secret-syncer-85jhb" (UID: "d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:50:34.623469 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:34.623356    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs podName:ef73cd15-199a-4b26-8f4f-4f0b860f4670 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:06.62334515 +0000 UTC m=+66.153887867 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs") pod "network-metrics-daemon-qvmdv" (UID: "ef73cd15-199a-4b26-8f4f-4f0b860f4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:50:34.723934 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:34.723896    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:34.724096 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:34.724078    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:50:34.724158 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:34.724102    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:50:34.724158 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:34.724114    2569 projected.go:196] Error preparing data for projected volume kube-api-access-qzg9j for pod openshift-network-diagnostics/network-check-target-9pgl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:34.724265 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:34.724179    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j podName:a01e0fa6-5fe0-46b0-b942-85ef83149e3b nodeName:}" failed. No retries permitted until 2026-07-16 21:51:06.724157605 +0000 UTC m=+66.254700328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzg9j" (UniqueName: "kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j") pod "network-check-target-9pgl5" (UID: "a01e0fa6-5fe0-46b0-b942-85ef83149e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:50:35.895373 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:35.895333    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:35.895373 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:35.895366    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:35.895908 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:35.895473    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-85jhb" podUID="d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb"
Jul 16 21:50:35.895908 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:35.895523    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:35.895908 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:35.895653    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pgl5" podUID="a01e0fa6-5fe0-46b0-b942-85ef83149e3b"
Jul 16 21:50:35.895908 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:35.895750    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvmdv" podUID="ef73cd15-199a-4b26-8f4f-4f0b860f4670"
Jul 16 21:50:35.941153 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:35.941114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:36.025502 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.025461    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:36.463318 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.463282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:36.546753 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.546717    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:36.683857 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.683804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:36.776251 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.776163    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-126.ec2.internal" event="NodeReady"
Jul 16 21:50:36.776415 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.776330    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 21:50:36.829560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.829508    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:36.866973 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.866940    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wp67m"]
Jul 16 21:50:36.872353 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.872330    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-52f86"]
Jul 16 21:50:36.872493 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.872449    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:36.875913 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.875892    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-52f86"
Jul 16 21:50:36.876768 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.876748    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g56tn\""
Jul 16 21:50:36.876891 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.876843    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 21:50:36.882377 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.882358    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 21:50:36.882760 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.882716    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 21:50:36.882760 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.882741    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 21:50:36.882911 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.882817    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 21:50:36.883052 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.882973    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vqlsj\""
Jul 16 21:50:36.889774 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.889750    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wp67m"]
Jul 16 21:50:36.904763 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.904734    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-52f86"]
Jul 16 21:50:36.962304 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:36.962273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:37.038564 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.038480    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frz57\" (UniqueName: \"kubernetes.io/projected/288099fc-cbd3-44b0-83ee-640f52284a86-kube-api-access-frz57\") pod \"ingress-canary-52f86\" (UID: \"288099fc-cbd3-44b0-83ee-640f52284a86\") " pod="openshift-ingress-canary/ingress-canary-52f86"
Jul 16 21:50:37.038564 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.038543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44081a2c-a610-4676-bb82-c13835d378c9-config-volume\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.038867 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.038651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44081a2c-a610-4676-bb82-c13835d378c9-tmp-dir\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.038867 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.038680    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmzll\" (UniqueName: \"kubernetes.io/projected/44081a2c-a610-4676-bb82-c13835d378c9-kube-api-access-kmzll\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.038867 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.038709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/288099fc-cbd3-44b0-83ee-640f52284a86-cert\") pod \"ingress-canary-52f86\" (UID: \"288099fc-cbd3-44b0-83ee-640f52284a86\") " pod="openshift-ingress-canary/ingress-canary-52f86"
Jul 16 21:50:37.038867 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.038732    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.139293 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.139257    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.139477 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.139316    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frz57\" (UniqueName: \"kubernetes.io/projected/288099fc-cbd3-44b0-83ee-640f52284a86-kube-api-access-frz57\") pod \"ingress-canary-52f86\" (UID: \"288099fc-cbd3-44b0-83ee-640f52284a86\") " pod="openshift-ingress-canary/ingress-canary-52f86"
Jul 16 21:50:37.139477 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.139370    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44081a2c-a610-4676-bb82-c13835d378c9-config-volume\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.139477 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.139420    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44081a2c-a610-4676-bb82-c13835d378c9-tmp-dir\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.139477 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:37.139424    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:50:37.139477 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.139446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmzll\" (UniqueName: \"kubernetes.io/projected/44081a2c-a610-4676-bb82-c13835d378c9-kube-api-access-kmzll\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.139759 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:37.139491    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls podName:44081a2c-a610-4676-bb82-c13835d378c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:37.639468759 +0000 UTC m=+37.170011467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls") pod "dns-default-wp67m" (UID: "44081a2c-a610-4676-bb82-c13835d378c9") : secret "dns-default-metrics-tls" not found
Jul 16 21:50:37.139759 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.139516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/288099fc-cbd3-44b0-83ee-640f52284a86-cert\") pod \"ingress-canary-52f86\" (UID: \"288099fc-cbd3-44b0-83ee-640f52284a86\") " pod="openshift-ingress-canary/ingress-canary-52f86"
Jul 16 21:50:37.140388 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.140165    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44081a2c-a610-4676-bb82-c13835d378c9-tmp-dir\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.140388 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.140299    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44081a2c-a610-4676-bb82-c13835d378c9-config-volume\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.144375 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.144352    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/288099fc-cbd3-44b0-83ee-640f52284a86-cert\") pod \"ingress-canary-52f86\" (UID: \"288099fc-cbd3-44b0-83ee-640f52284a86\") " pod="openshift-ingress-canary/ingress-canary-52f86"
Jul 16 21:50:37.152718 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.152666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmzll\" (UniqueName: \"kubernetes.io/projected/44081a2c-a610-4676-bb82-c13835d378c9-kube-api-access-kmzll\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.152868 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.152763    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frz57\" (UniqueName: \"kubernetes.io/projected/288099fc-cbd3-44b0-83ee-640f52284a86-kube-api-access-frz57\") pod \"ingress-canary-52f86\" (UID: \"288099fc-cbd3-44b0-83ee-640f52284a86\") " pod="openshift-ingress-canary/ingress-canary-52f86"
Jul 16 21:50:37.173743 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.173708    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:37.191727 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.191699    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-52f86"
Jul 16 21:50:37.283515 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.283470    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:37.474098 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.474062    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qbzg2"]
Jul 16 21:50:37.477851 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.477820    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.480828 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.480804    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 21:50:37.481423 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.481323    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q652x\""
Jul 16 21:50:37.481423 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.481377    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 21:50:37.481606 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.481484    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 21:50:37.481606 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.481481    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 21:50:37.494518 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.494491    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qbzg2"]
Jul 16 21:50:37.525675 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.525642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:37.640700 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.640677    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:37.643722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.643699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-crio-socket\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.643870 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.643727    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbwjp\" (UniqueName: \"kubernetes.io/projected/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-api-access-dbwjp\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.643870 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.643747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.643870 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.643770    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-data-volume\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.644100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.643942    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.644100 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.643984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:37.644202 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:37.644157    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:50:37.644250 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:37.644214    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls podName:44081a2c-a610-4676-bb82-c13835d378c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:38.644196217 +0000 UTC m=+38.174738922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls") pod "dns-default-wp67m" (UID: "44081a2c-a610-4676-bb82-c13835d378c9") : secret "dns-default-metrics-tls" not found
Jul 16 21:50:37.645119 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.645094    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-52f86"]
Jul 16 21:50:37.649110 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:37.649085    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288099fc_cbd3_44b0_83ee_640f52284a86.slice/crio-86610b076088dc5789c3dae7965fcac2c974ae34f43c63ad587f5e64dfbc5a4b WatchSource:0}: Error finding container 86610b076088dc5789c3dae7965fcac2c974ae34f43c63ad587f5e64dfbc5a4b: Status 404 returned error can't find the container with id 86610b076088dc5789c3dae7965fcac2c974ae34f43c63ad587f5e64dfbc5a4b
Jul 16 21:50:37.742707 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.742678    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:37.744766 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.744744    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.744856 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.744809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-crio-socket\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.744856 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.744841    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwjp\" (UniqueName: \"kubernetes.io/projected/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-api-access-dbwjp\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.744954 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:37.744867    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:50:37.744954 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.744872    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.744954 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:37.744929    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm podName:58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:38.244912984 +0000 UTC m=+37.775455705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qbzg2" (UID: "58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32") : configmap "kube-rbac-proxy" not found
Jul 16 21:50:37.744954 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.744946    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-data-volume\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.745147 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:37.745131    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:37.745201 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:37.745189    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls podName:58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:38.245172615 +0000 UTC m=+37.775715323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbzg2" (UID: "58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:37.745255 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.745129    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-crio-socket\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.745332 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.745315    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-data-volume\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.756555 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.756530    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwjp\" (UniqueName: \"kubernetes.io/projected/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-api-access-dbwjp\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:37.819971 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.819938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:37.895558 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.895521    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:50:37.895721 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.895527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:50:37.895721 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.895533    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:50:37.898892 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.898872    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:50:37.898997 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.898869    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:50:37.898997 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.898931    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:50:37.899109 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.899002    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:50:37.899109 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.899033    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qpnd8\""
Jul 16 21:50:37.899109 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:37.899106    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nn8m8\""
Jul 16 21:50:38.045477 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.045391    2569 generic.go:356] "Generic (PLEG): container finished" podID="d4054768-5b74-4537-80b2-dd8d55c495ff" containerID="a93ec1199d04d03993e0d4ad55ee5173b333bced7b53163dfebab9addc7e6929" exitCode=0
Jul 16 21:50:38.045477 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.045460    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htsst" event={"ID":"d4054768-5b74-4537-80b2-dd8d55c495ff","Type":"ContainerDied","Data":"a93ec1199d04d03993e0d4ad55ee5173b333bced7b53163dfebab9addc7e6929"}
Jul 16 21:50:38.046603 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.046578    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-52f86" event={"ID":"288099fc-cbd3-44b0-83ee-640f52284a86","Type":"ContainerStarted","Data":"86610b076088dc5789c3dae7965fcac2c974ae34f43c63ad587f5e64dfbc5a4b"}
Jul 16 21:50:38.250058 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.249803    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:38.250245 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:38.249965    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:38.250245 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.250154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:38.250245 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:38.250211    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls podName:58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:39.250188417 +0000 UTC m=+38.780731126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbzg2" (UID: "58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:38.250245 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:38.250244    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:50:38.250448 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:38.250299    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm podName:58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:39.250281427 +0000 UTC m=+38.780824140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qbzg2" (UID: "58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32") : configmap "kube-rbac-proxy" not found
Jul 16 21:50:38.654602 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.654569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:38.654785 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:38.654745    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:50:38.654854 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:38.654818    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls podName:44081a2c-a610-4676-bb82-c13835d378c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:40.65480124 +0000 UTC m=+40.185343968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls") pod "dns-default-wp67m" (UID: "44081a2c-a610-4676-bb82-c13835d378c9") : secret "dns-default-metrics-tls" not found
Jul 16 21:50:38.782052 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.782011    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-7cmlg"]
Jul 16 21:50:38.785401 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.785373    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:38.788349 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.788327    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 21:50:38.788718 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.788649    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 21:50:38.788796 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.788761    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wtdbj\""
Jul 16 21:50:38.789218 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.789170    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 21:50:38.789292 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.789230    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 21:50:38.803972 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.803944    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-7cmlg"]
Jul 16 21:50:38.830824 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.830795    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:38.909154 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.909045    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:38.957050 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.957014    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9089f3e9-64b3-481b-8937-f16992ab714f-signing-cabundle\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:38.957231 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.957131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm7tt\" (UniqueName: \"kubernetes.io/projected/9089f3e9-64b3-481b-8937-f16992ab714f-kube-api-access-gm7tt\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:38.957298 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:38.957230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9089f3e9-64b3-481b-8937-f16992ab714f-signing-key\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:39.053326 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.053291    2569 generic.go:356] "Generic (PLEG): container finished" podID="d4054768-5b74-4537-80b2-dd8d55c495ff" containerID="27294497902ba5cc023393d4f5a9a1940de911ab8fd2e3b058656e9830d7c9eb" exitCode=0
Jul 16 21:50:39.053799 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.053342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htsst" event={"ID":"d4054768-5b74-4537-80b2-dd8d55c495ff","Type":"ContainerDied","Data":"27294497902ba5cc023393d4f5a9a1940de911ab8fd2e3b058656e9830d7c9eb"}
Jul 16 21:50:39.058322 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.058297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9089f3e9-64b3-481b-8937-f16992ab714f-signing-cabundle\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:39.058451 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.058372    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm7tt\" (UniqueName: \"kubernetes.io/projected/9089f3e9-64b3-481b-8937-f16992ab714f-kube-api-access-gm7tt\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:39.058451 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.058422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9089f3e9-64b3-481b-8937-f16992ab714f-signing-key\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:39.059287 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.059239    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9089f3e9-64b3-481b-8937-f16992ab714f-signing-cabundle\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:39.062336 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.062309    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9089f3e9-64b3-481b-8937-f16992ab714f-signing-key\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:39.069116 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.069089    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm7tt\" (UniqueName: \"kubernetes.io/projected/9089f3e9-64b3-481b-8937-f16992ab714f-kube-api-access-gm7tt\") pod \"service-ca-58598695f7-7cmlg\" (UID: \"9089f3e9-64b3-481b-8937-f16992ab714f\") " pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:39.095936 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.095893    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-7cmlg"
Jul 16 21:50:39.247186 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.247144    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-7cmlg"]
Jul 16 21:50:39.260428 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.260399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:39.260563 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.260482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:39.260651 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:39.260563    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:50:39.260651 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:39.260578    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:39.260651 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:39.260637    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm podName:58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:41.26060817 +0000 UTC m=+40.791150879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qbzg2" (UID: "58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32") : configmap "kube-rbac-proxy" not found
Jul 16 21:50:39.260651 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:39.260652    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls podName:58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:41.260644529 +0000 UTC m=+40.791187234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbzg2" (UID: "58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:39.865528 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:39.865379    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9089f3e9_64b3_481b_8937_f16992ab714f.slice/crio-dafbea760b2ecdeb2ea0d583d832fe847207337a67c2611e76a3f2bed09d0491 WatchSource:0}: Error finding container dafbea760b2ecdeb2ea0d583d832fe847207337a67c2611e76a3f2bed09d0491: Status 404 returned error can't find the container with id dafbea760b2ecdeb2ea0d583d832fe847207337a67c2611e76a3f2bed09d0491
Jul 16 21:50:39.881363 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:39.881340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:40.056603 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.056560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-7cmlg" event={"ID":"9089f3e9-64b3-481b-8937-f16992ab714f","Type":"ContainerStarted","Data":"dafbea760b2ecdeb2ea0d583d832fe847207337a67c2611e76a3f2bed09d0491"}
Jul 16 21:50:40.057269 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.057247    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7ppr6_2d3d9722-1652-4888-9fca-a110e9241f0d/dns-node-resolver/0.log"
Jul 16 21:50:40.059892 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.059866    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htsst" event={"ID":"d4054768-5b74-4537-80b2-dd8d55c495ff","Type":"ContainerStarted","Data":"27a29078d478eb9c8182f90be5f2387923c70ff860e54c85c1dce3339ad6ece4"}
Jul 16 21:50:40.061249 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.061225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-52f86" event={"ID":"288099fc-cbd3-44b0-83ee-640f52284a86","Type":"ContainerStarted","Data":"6bbad3da4877d5237693d55dc1437727a1a9697d356521de1f0fa7309dd48b26"}
Jul 16 21:50:40.089518 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.089467    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-htsst" podStartSLOduration=9.060384022 podStartE2EDuration="40.089450944s" totalImagesPullingTime="31.029066922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:40.087645069 +0000 UTC m=+39.618187787" watchObservedRunningTime="2026-07-16 21:50:40.089450944 +0000 UTC m=+39.619993648"
Jul 16 21:50:40.110502 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.110445    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-52f86" podStartSLOduration=1.833127296 podStartE2EDuration="4.110429467s" totalImagesPullingTime="2.277302171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:40.109988059 +0000 UTC m=+39.640530796" watchObservedRunningTime="2026-07-16 21:50:40.110429467 +0000 UTC m=+39.640972244"
Jul 16 21:50:40.323413 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.323334    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:40.507487 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.507458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:40.617349 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.617260    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:40.674418 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.674381    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:40.674605 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:40.674535    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:50:40.674605 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:40.674603    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls podName:44081a2c-a610-4676-bb82-c13835d378c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:44.674587127 +0000 UTC m=+44.205129833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls") pod "dns-default-wp67m" (UID: "44081a2c-a610-4676-bb82-c13835d378c9") : secret "dns-default-metrics-tls" not found
Jul 16 21:50:40.788433 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:40.788401    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:41.009147 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:41.009109    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:41.278954 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:41.278868    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:41.278954 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:41.278933    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:41.279573 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:41.279051    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:41.279573 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:41.279127    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls podName:58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.279108534 +0000 UTC m=+44.809651255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbzg2" (UID: "58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:41.279573 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:41.279386    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:41.466838 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:41.466813    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqz4m_993b5a35-6803-4ee4-9bc8-2df7b42d3491/node-ca/0.log"
Jul 16 21:50:41.855937 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:41.855910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-52f86_288099fc-cbd3-44b0-83ee-640f52284a86/serve-healthcheck-canary/0.log"
Jul 16 21:50:42.063552 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:42.063519    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:43.069378 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:43.069341    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-7cmlg" event={"ID":"9089f3e9-64b3-481b-8937-f16992ab714f","Type":"ContainerStarted","Data":"7c03eda9fab117dacb258c499cb75d91e75cf7f66b9febbe8425873ecc7d7fa2"}
Jul 16 21:50:43.087127 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:43.087075    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-7cmlg" podStartSLOduration=2.581370469 podStartE2EDuration="5.087060229s" totalImagesPullingTime="2.50568976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:43.086124524 +0000 UTC m=+42.616667270" watchObservedRunningTime="2026-07-16 21:50:43.087060229 +0000 UTC m=+42.617602934"
Jul 16 21:50:43.737210 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:43.737170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:43.922512 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:43.922474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:44.029612 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:44.029515    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:44.100512 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:44.100476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:44.705549 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:44.705512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:44.705722 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:44.705647    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:50:44.705722 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:44.705706    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls podName:44081a2c-a610-4676-bb82-c13835d378c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:52.705692054 +0000 UTC m=+52.236234758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls") pod "dns-default-wp67m" (UID: "44081a2c-a610-4676-bb82-c13835d378c9") : secret "dns-default-metrics-tls" not found
Jul 16 21:50:45.075640 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:45.075540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:45.239538 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:45.239504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:45.312121 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:45.312082    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:45.312264 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:45.312204    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:45.312315 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:50:45.312275    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls podName:58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:53.31225745 +0000 UTC m=+52.842800156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbzg2" (UID: "58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:50:45.641789 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:45.641757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:45.832375 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:45.832340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:46.030635 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:46.030589    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:47.047579 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:47.047551    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:47.279204 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:47.279150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:47.430583 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:47.430502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:47.636757 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:47.636694    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:47.737465 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:47.737439    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:47.935059 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:47.935025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:48.438734 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:48.438701    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:48.540453 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:48.540424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:49.031399 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:49.031370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:49.235899 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:49.235865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:49.753677 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:49.753643    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:49.870673 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:49.870639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:50.045316 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:50.045233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:50.687676 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:50.687643    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:50.899773 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:50.899745    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:51.014199 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:51.014168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:51.237289 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:51.237258    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:51.439683 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:51.439583    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:51.854564 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:51.854532    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:52.631692 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:52.631660    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:52.768373 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:52.768334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:52.771743 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:52.771723    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44081a2c-a610-4676-bb82-c13835d378c9-metrics-tls\") pod \"dns-default-wp67m\" (UID: \"44081a2c-a610-4676-bb82-c13835d378c9\") " pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:52.784636 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:52.784593    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:52.840531 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:52.840499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:52.944200 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:52.944166    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wp67m"]
Jul 16 21:50:52.960802 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:52.960774    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44081a2c_a610_4676_bb82_c13835d378c9.slice/crio-78328905dd114cbdbfc5cd2b87791cb328d7ba9162cee76ea5c7909c01597011 WatchSource:0}: Error finding container 78328905dd114cbdbfc5cd2b87791cb328d7ba9162cee76ea5c7909c01597011: Status 404 returned error can't find the container with id 78328905dd114cbdbfc5cd2b87791cb328d7ba9162cee76ea5c7909c01597011
Jul 16 21:50:53.095929 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:53.095885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp67m" event={"ID":"44081a2c-a610-4676-bb82-c13835d378c9","Type":"ContainerStarted","Data":"78328905dd114cbdbfc5cd2b87791cb328d7ba9162cee76ea5c7909c01597011"}
Jul 16 21:50:53.240382 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:53.240344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:53.373834 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:53.373798    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:53.376174 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:53.376141    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbzg2\" (UID: \"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32\") " pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:53.389723 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:53.389699    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qbzg2"
Jul 16 21:50:53.429605 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:53.429572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:53.541603 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:53.541519    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qbzg2"]
Jul 16 21:50:53.544957 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:53.544925    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e6c7f5_4ce6_4b52_adeb_2dc2e7734a32.slice/crio-c66908b43818e6392ca80dd47f73c7189aedb16d4cbea6efde36671ddb9d962d WatchSource:0}: Error finding container c66908b43818e6392ca80dd47f73c7189aedb16d4cbea6efde36671ddb9d962d: Status 404 returned error can't find the container with id c66908b43818e6392ca80dd47f73c7189aedb16d4cbea6efde36671ddb9d962d
Jul 16 21:50:53.633801 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:53.633762    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:54.108022 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:54.107971    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbzg2" event={"ID":"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32","Type":"ContainerStarted","Data":"c66908b43818e6392ca80dd47f73c7189aedb16d4cbea6efde36671ddb9d962d"}
Jul 16 21:50:54.233499 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:54.233415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:54.431506 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:54.431425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:55.035599 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:55.035565    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:55.134915 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:55.134879    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:55.234686 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:55.234644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:55.462519 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:55.462480    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:55.561656 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:55.561479    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:55.727050 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:55.727019    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:56.114767 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.114729    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp67m" event={"ID":"44081a2c-a610-4676-bb82-c13835d378c9","Type":"ContainerStarted","Data":"4c1475f26abe81888b38cf0f2b9fef2f17371a7d6008bd2e891cf882a2027d8c"}
Jul 16 21:50:56.115229 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.114793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp67m" event={"ID":"44081a2c-a610-4676-bb82-c13835d378c9","Type":"ContainerStarted","Data":"05418a49e64fd1e73922430b21befa8f4d8d8e33dd5186b4959db5d4480b66f9"}
Jul 16 21:50:56.115229 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.114934    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wp67m"
Jul 16 21:50:56.145482 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.145431    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wp67m" podStartSLOduration=17.869281739 podStartE2EDuration="20.145410075s" totalImagesPullingTime="2.276128336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:56.14453793 +0000 UTC m=+55.675080654" watchObservedRunningTime="2026-07-16 21:50:56.145410075 +0000 UTC m=+55.675952803"
Jul 16 21:50:56.302056 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.302025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:56.443351 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.443234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:56.714075 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.714035    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:56.920722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.920684    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:56.992670 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:56.992551    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:57.533808 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:57.533777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:58.469981 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.469926    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"]
Jul 16 21:50:58.473611 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.473587    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"]
Jul 16 21:50:58.473772 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.473721    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"
Jul 16 21:50:58.476678 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.476658    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.485952 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.485928    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 21:50:58.486248 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.486232    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 21:50:58.486342 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.486321    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 21:50:58.486410 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.486336    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 21:50:58.487309 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.487286    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 21:50:58.487309 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.487300    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 21:50:58.492208 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.492189    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"]
Jul 16 21:50:58.496003 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.495980    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 21:50:58.496210 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.496189    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-tvzpp\""
Jul 16 21:50:58.500724 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.500701    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 21:50:58.504989 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.504963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.505125 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.505001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8d46601-b28f-47f8-9304-8fad0495fc6f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.505125 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.505035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.505125 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.505074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/867ee315-3f1f-4436-8c16-9bbec460ebff-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z\" (UID: \"867ee315-3f1f-4436-8c16-9bbec460ebff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"
Jul 16 21:50:58.505265 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.505123    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9pxl\" (UniqueName: \"kubernetes.io/projected/867ee315-3f1f-4436-8c16-9bbec460ebff-kube-api-access-c9pxl\") pod \"managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z\" (UID: \"867ee315-3f1f-4436-8c16-9bbec460ebff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"
Jul 16 21:50:58.505265 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.505179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-hub\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.505265 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.505214    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-ca\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.505265 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.505238    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2wss\" (UniqueName: \"kubernetes.io/projected/b8d46601-b28f-47f8-9304-8fad0495fc6f-kube-api-access-r2wss\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.541399 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.541094    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"]
Jul 16 21:50:58.606489 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.606452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-ca\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.606489 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.606492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2wss\" (UniqueName: \"kubernetes.io/projected/b8d46601-b28f-47f8-9304-8fad0495fc6f-kube-api-access-r2wss\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.606813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.606727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.606813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.606767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8d46601-b28f-47f8-9304-8fad0495fc6f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.606813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.606809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.606962 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.606834    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/867ee315-3f1f-4436-8c16-9bbec460ebff-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z\" (UID: \"867ee315-3f1f-4436-8c16-9bbec460ebff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"
Jul 16 21:50:58.606962 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.606862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pxl\" (UniqueName: \"kubernetes.io/projected/867ee315-3f1f-4436-8c16-9bbec460ebff-kube-api-access-c9pxl\") pod \"managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z\" (UID: \"867ee315-3f1f-4436-8c16-9bbec460ebff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"
Jul 16 21:50:58.606962 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.606916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-hub\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.607636 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.607577    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8d46601-b28f-47f8-9304-8fad0495fc6f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.609798 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.609256    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.609798 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.609427    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-ca\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.609977 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.609802    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/867ee315-3f1f-4436-8c16-9bbec460ebff-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z\" (UID: \"867ee315-3f1f-4436-8c16-9bbec460ebff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"
Jul 16 21:50:58.610093 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.610073    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.610242 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.610224    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8d46601-b28f-47f8-9304-8fad0495fc6f-hub\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.632967 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.632939    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2wss\" (UniqueName: \"kubernetes.io/projected/b8d46601-b28f-47f8-9304-8fad0495fc6f-kube-api-access-r2wss\") pod \"cluster-proxy-proxy-agent-5557ccd6-bh9s5\" (UID: \"b8d46601-b28f-47f8-9304-8fad0495fc6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.643871 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.643841    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9pxl\" (UniqueName: \"kubernetes.io/projected/867ee315-3f1f-4436-8c16-9bbec460ebff-kube-api-access-c9pxl\") pod \"managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z\" (UID: \"867ee315-3f1f-4436-8c16-9bbec460ebff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"
Jul 16 21:50:58.694108 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.693903    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:58.791077 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.791039    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"
Jul 16 21:50:58.797781 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.797755    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"
Jul 16 21:50:58.889794 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.889759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:58.928769 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.928735    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z"]
Jul 16 21:50:58.931839 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:58.931801    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod867ee315_3f1f_4436_8c16_9bbec460ebff.slice/crio-fcadc68a6bac65398b1312d68ed04dd1da0770c0d43d14ffd913f7a6f4408c49 WatchSource:0}: Error finding container fcadc68a6bac65398b1312d68ed04dd1da0770c0d43d14ffd913f7a6f4408c49: Status 404 returned error can't find the container with id fcadc68a6bac65398b1312d68ed04dd1da0770c0d43d14ffd913f7a6f4408c49
Jul 16 21:50:58.946589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.946563    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5"]
Jul 16 21:50:58.949054 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:50:58.949016    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8d46601_b28f_47f8_9304_8fad0495fc6f.slice/crio-dbb31ae514916d68d2087734216c5fa05b63c13d98cf01445a4f9ee6412681f3 WatchSource:0}: Error finding container dbb31ae514916d68d2087734216c5fa05b63c13d98cf01445a4f9ee6412681f3: Status 404 returned error can't find the container with id dbb31ae514916d68d2087734216c5fa05b63c13d98cf01445a4f9ee6412681f3
Jul 16 21:50:58.990125 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:58.990028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:59.123146 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:59.123110    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z" event={"ID":"867ee315-3f1f-4436-8c16-9bbec460ebff","Type":"ContainerStarted","Data":"fcadc68a6bac65398b1312d68ed04dd1da0770c0d43d14ffd913f7a6f4408c49"}
Jul 16 21:50:59.124244 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:59.124212    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5" event={"ID":"b8d46601-b28f-47f8-9304-8fad0495fc6f","Type":"ContainerStarted","Data":"dbb31ae514916d68d2087734216c5fa05b63c13d98cf01445a4f9ee6412681f3"}
Jul 16 21:50:59.125506 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:50:59.125486    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbzg2" event={"ID":"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32","Type":"ContainerStarted","Data":"86a125e29b0853337b0d7691bbe5e6cb0b6b7e560a9ec85adf8f03133c322dab"}
Jul 16 21:51:00.036093 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:00.036022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:00.170943 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:00.170855    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:01.733700 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:01.733659    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:01.812957 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:01.812916    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:01.899515 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:01.899481    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:02.042988 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:02.042904    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx7jg"
Jul 16 21:51:02.334426 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:02.334346    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:02.446211 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:02.446164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:02.710903 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:02.710869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:02.808613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:02.808581    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:03.013870 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:03.013793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:03.115298 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:03.115268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:03.443085 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:03.443011    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:03.538128 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:03.538082    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:05.856167 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:05.856123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:05.962511 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:05.962474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:06.079609 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.079577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:06.119764 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.119683    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wp67m"
Jul 16 21:51:06.148670 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.148608    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z" event={"ID":"867ee315-3f1f-4436-8c16-9bbec460ebff","Type":"ContainerStarted","Data":"3e568cb9e4f83401b960d1bdfe84024c24be6e0506fc97c3143040183c202faa"}
Jul 16 21:51:06.151052 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.151018    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5" event={"ID":"b8d46601-b28f-47f8-9304-8fad0495fc6f","Type":"ContainerStarted","Data":"a4448e82ecbcfdc49efc7a9337beeb0f54b1da9ae71b9ec06e08c4899585abf6"}
Jul 16 21:51:06.151189 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.151064    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5" event={"ID":"b8d46601-b28f-47f8-9304-8fad0495fc6f","Type":"ContainerStarted","Data":"ce817f409cfaba5cc40b01cf6257b8c7cd93615e46f70f4143f9abf1b7e08348"}
Jul 16 21:51:06.151189 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.151083    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5" event={"ID":"b8d46601-b28f-47f8-9304-8fad0495fc6f","Type":"ContainerStarted","Data":"f72171e9809697fa23d16493f3b97491394e5cf5ba1e480155f386093aa4dca5"}
Jul 16 21:51:06.153278 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.153237    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbzg2" event={"ID":"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32","Type":"ContainerStarted","Data":"b0ba33f830deb29c3ebe18daf7ac914296a9fb2f7f40662d627b42dbd2adb7d2"}
Jul 16 21:51:06.197147 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.197079    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557ccd6-bh9s5" podStartSLOduration=1.960246931 podStartE2EDuration="8.197054576s" totalImagesPullingTime="6.236807645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:06.196442295 +0000 UTC m=+65.726985023" watchObservedRunningTime="2026-07-16 21:51:06.197054576 +0000 UTC m=+65.727597398"
Jul 16 21:51:06.230376 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.230310    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fb94ff5d-9dk4z" podStartSLOduration=1.994377712 podStartE2EDuration="8.230289129s" totalImagesPullingTime="6.235911417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:06.229751011 +0000 UTC m=+65.760293738" watchObservedRunningTime="2026-07-16 21:51:06.230289129 +0000 UTC m=+65.760831857"
Jul 16 21:51:06.680543 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.680505    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:51:06.680748 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.680581    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:51:06.683628 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.683594    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:51:06.683750 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.683630    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:51:06.694145 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.694111    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb-original-pull-secret\") pod \"global-pull-secret-syncer-85jhb\" (UID: \"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb\") " pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:51:06.694145 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.694100    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef73cd15-199a-4b26-8f4f-4f0b860f4670-metrics-certs\") pod \"network-metrics-daemon-qvmdv\" (UID: \"ef73cd15-199a-4b26-8f4f-4f0b860f4670\") " pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:51:06.714067 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.714027    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-85jhb"
Jul 16 21:51:06.721224 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.721194    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nn8m8\""
Jul 16 21:51:06.728719 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.728688    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvmdv"
Jul 16 21:51:06.782011 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.781659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:51:06.788010 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.787747    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:51:06.795722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.795691    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:51:06.807125 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.807099    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzg9j\" (UniqueName: \"kubernetes.io/projected/a01e0fa6-5fe0-46b0-b942-85ef83149e3b-kube-api-access-qzg9j\") pod \"network-check-target-9pgl5\" (UID: \"a01e0fa6-5fe0-46b0-b942-85ef83149e3b\") " pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:51:06.877936 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.877892    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-85jhb"]
Jul 16 21:51:06.882084 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:51:06.882049    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fc421f_ea4c_45a7_a7c6_487c7fb8aceb.slice/crio-272a98e82b53761e908a48478578ce8c8d98b5bcc1c638befd9707c647c56784 WatchSource:0}: Error finding container 272a98e82b53761e908a48478578ce8c8d98b5bcc1c638befd9707c647c56784: Status 404 returned error can't find the container with id 272a98e82b53761e908a48478578ce8c8d98b5bcc1c638befd9707c647c56784
Jul 16 21:51:06.902184 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:06.902153    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvmdv"]
Jul 16 21:51:06.906104 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:51:06.906082    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef73cd15_199a_4b26_8f4f_4f0b860f4670.slice/crio-64f4b56385e73efd4038cbb040b136dd898bc75088a1f38cb38a32f4ebfa3e15 WatchSource:0}: Error finding container 64f4b56385e73efd4038cbb040b136dd898bc75088a1f38cb38a32f4ebfa3e15: Status 404 returned error can't find the container with id 64f4b56385e73efd4038cbb040b136dd898bc75088a1f38cb38a32f4ebfa3e15
Jul 16 21:51:07.011554 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.011528    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qpnd8\""
Jul 16 21:51:07.019226 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.019187    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:51:07.159242 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.159208    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pgl5"]
Jul 16 21:51:07.159552 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.159518    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-85jhb" event={"ID":"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb","Type":"ContainerStarted","Data":"272a98e82b53761e908a48478578ce8c8d98b5bcc1c638befd9707c647c56784"}
Jul 16 21:51:07.160902 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.160863    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvmdv" event={"ID":"ef73cd15-199a-4b26-8f4f-4f0b860f4670","Type":"ContainerStarted","Data":"64f4b56385e73efd4038cbb040b136dd898bc75088a1f38cb38a32f4ebfa3e15"}
Jul 16 21:51:07.600967 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.600920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:07.743230 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.743184    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:07.907542 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.907467    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:07.999941 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:07.999907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:08.558767 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:08.558732    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:08.665834 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:08.665795    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:08.724119 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:51:08.724089    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01e0fa6_5fe0_46b0_b942_85ef83149e3b.slice/crio-7924f7561688640d9d41a661609816a92448f8ae77104b9334eac8c3f693cfc7 WatchSource:0}: Error finding container 7924f7561688640d9d41a661609816a92448f8ae77104b9334eac8c3f693cfc7: Status 404 returned error can't find the container with id 7924f7561688640d9d41a661609816a92448f8ae77104b9334eac8c3f693cfc7
Jul 16 21:51:08.789205 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:08.789177    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:09.170608 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:09.170485    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbzg2" event={"ID":"58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32","Type":"ContainerStarted","Data":"f630dc66aeb3a9261073a8a2ae7ff51d6902b6183da3c472003b2560cccb5e9d"}
Jul 16 21:51:09.172136 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:09.172101    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pgl5" event={"ID":"a01e0fa6-5fe0-46b0-b942-85ef83149e3b","Type":"ContainerStarted","Data":"7924f7561688640d9d41a661609816a92448f8ae77104b9334eac8c3f693cfc7"}
Jul 16 21:51:09.194504 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:09.194433    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qbzg2" podStartSLOduration=17.088149313 podStartE2EDuration="32.194411449s" totalImagesPullingTime="15.106262136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:09.192855181 +0000 UTC m=+68.723397907" watchObservedRunningTime="2026-07-16 21:51:09.194411449 +0000 UTC m=+68.724954178"
Jul 16 21:51:09.743609 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:09.743541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:09.846795 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:09.846757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:09.945216 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:09.945152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:10.177951 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:10.177913    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvmdv" event={"ID":"ef73cd15-199a-4b26-8f4f-4f0b860f4670","Type":"ContainerStarted","Data":"6348eee034af601ba0964ce1a7af88c1c40904056f7361e909013c0970d6b5b3"}
Jul 16 21:51:11.018522 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:11.018488    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:11.119801 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:11.119768    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:11.183962 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:11.183920    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvmdv" event={"ID":"ef73cd15-199a-4b26-8f4f-4f0b860f4670","Type":"ContainerStarted","Data":"cdfa8daf5072d1a09153a01d401f8e21e3fb8d9133df305e620941a2988c1225"}
Jul 16 21:51:11.204241 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:11.204182    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qvmdv" podStartSLOduration=67.229565333 podStartE2EDuration="1m10.204164188s" totalImagesPullingTime="2.974598855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:11.20246091 +0000 UTC m=+70.733003638" watchObservedRunningTime="2026-07-16 21:51:11.204164188 +0000 UTC m=+70.734706914"
Jul 16 21:51:11.310766 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:11.310660    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:11.390772 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:11.390740    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:11.550216 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:11.550177    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:11.655169 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:11.655064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:14.196611 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:14.196571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pgl5" event={"ID":"a01e0fa6-5fe0-46b0-b942-85ef83149e3b","Type":"ContainerStarted","Data":"3047cbc81c0c69651d3eb4648c057549babd35df5371193ede531cbe475a3c0e"}
Jul 16 21:51:14.197119 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:14.196657    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:51:14.197970 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:14.197944    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-85jhb" event={"ID":"d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb","Type":"ContainerStarted","Data":"9e36966c350521dc6814998d0b42fc90815eba282103f37f86acfe4a77adb658"}
Jul 16 21:51:14.293679 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:14.293607    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9pgl5" podStartSLOduration=68.605648028 podStartE2EDuration="1m13.293589208s" totalImagesPullingTime="4.68794118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:14.247656726 +0000 UTC m=+73.778199452" watchObservedRunningTime="2026-07-16 21:51:14.293589208 +0000 UTC m=+73.824131961"
Jul 16 21:51:14.293946 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:14.293925    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-85jhb" podStartSLOduration=66.760293951 podStartE2EDuration="1m13.293917915s" totalImagesPullingTime="6.533623964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:14.292872142 +0000 UTC m=+73.823414870" watchObservedRunningTime="2026-07-16 21:51:14.293917915 +0000 UTC m=+73.824460674"
Jul 16 21:51:14.849508 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:14.849476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:14.961343 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:14.961312    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:16.167153 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:16.167128    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:16.270354 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:16.270323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:17.278569 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:17.278533    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:17.541283 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:17.541198    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:17.714894 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:17.714864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:17.809234 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:17.809149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:19.379357 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:19.379323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:19.535764 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:19.535730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:20.209854 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:20.209825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:20.305683 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:20.305649    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:20.585355 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:20.585273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:20.699576 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:20.699540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:20.872822 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:20.872740    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:20.967530 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:20.967497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:25.839380 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:25.839227    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:25.964854 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:25.964827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:26.241779 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:26.241741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:26.369253 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:26.369222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:26.669580 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:26.669497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:28.944324 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:28.944296    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:29.020250 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:29.020203    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:29.566473 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:29.566445    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:30.446600 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:30.446566    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:30.553532 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:30.553498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:31.053547 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.053511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:31.198813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.198782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:31.342104 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.342020    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:31.407047 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.407001    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"]
Jul 16 21:51:31.476864 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.476831    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:31.570992 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.570952    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fdrzb"]
Jul 16 21:51:31.571163 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.571087    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.579556 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.579536    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 21:51:31.579739 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.579708    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 21:51:31.579816 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.579779    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 21:51:31.580724 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.580701    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-62qs5\""
Jul 16 21:51:31.580826 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.580735    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 21:51:31.580826 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.580736    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 21:51:31.596141 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.596078    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"]
Jul 16 21:51:31.596233 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.596218    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.599753 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.599722    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 21:51:31.599870 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.599814    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 21:51:31.600499 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.600484    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 21:51:31.600589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.600537    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l45wb\""
Jul 16 21:51:31.610398 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.610363    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:31.660731 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.660692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-root\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.660909 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.660737    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d92f6bd7-4915-4bd9-a35a-f419db791188-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.660909 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.660776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.660909 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.660801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-wtmp\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.660909 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.660822    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-metrics-client-ca\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.660909 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.660878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92f6bd7-4915-4bd9-a35a-f419db791188-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.661114 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.660954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-sys\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.661114 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.660976    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwl7f\" (UniqueName: \"kubernetes.io/projected/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-kube-api-access-kwl7f\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.661114 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.661004    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d92f6bd7-4915-4bd9-a35a-f419db791188-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.661114 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.661021    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-textfile\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.661114 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.661069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.661114 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.661110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-tls\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.661312 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.661159    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2w8c\" (UniqueName: \"kubernetes.io/projected/d92f6bd7-4915-4bd9-a35a-f419db791188-kube-api-access-f2w8c\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.719005 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.718968    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:31.762229 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-root\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.762229 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d92f6bd7-4915-4bd9-a35a-f419db791188-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762263    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762283    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-wtmp\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-metrics-client-ca\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92f6bd7-4915-4bd9-a35a-f419db791188-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-sys\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwl7f\" (UniqueName: \"kubernetes.io/projected/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-kube-api-access-kwl7f\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762397    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d92f6bd7-4915-4bd9-a35a-f419db791188-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762420    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-textfile\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762435    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-wtmp\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.762486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762447    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.763065 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-tls\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.763065 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2w8c\" (UniqueName: \"kubernetes.io/projected/d92f6bd7-4915-4bd9-a35a-f419db791188-kube-api-access-f2w8c\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.763065 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762564    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-sys\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.763065 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762343    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-root\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.763065 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.762958    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.763065 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.763015    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-metrics-client-ca\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.763375 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.763066    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92f6bd7-4915-4bd9-a35a-f419db791188-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.763375 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.763212    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-textfile\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.765070 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.765040    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-tls\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.765274 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.765249    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.765408 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.765391    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d92f6bd7-4915-4bd9-a35a-f419db791188-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.765473 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.765437    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d92f6bd7-4915-4bd9-a35a-f419db791188-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.773374 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.773330    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2w8c\" (UniqueName: \"kubernetes.io/projected/d92f6bd7-4915-4bd9-a35a-f419db791188-kube-api-access-f2w8c\") pod \"openshift-state-metrics-79f6958cdf-hmcn2\" (UID: \"d92f6bd7-4915-4bd9-a35a-f419db791188\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.773526 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.773490    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwl7f\" (UniqueName: \"kubernetes.io/projected/29dc197d-55e1-4798-8ff5-13b4f3cbf6ae-kube-api-access-kwl7f\") pod \"node-exporter-fdrzb\" (UID: \"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae\") " pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.819562 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.819522    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:31.879871 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.879778    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"
Jul 16 21:51:31.905290 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:31.905260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdrzb"
Jul 16 21:51:31.943300 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:51:31.943244    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29dc197d_55e1_4798_8ff5_13b4f3cbf6ae.slice/crio-e45614c8aa741ba8190a78f1c1048acf10be7de1ea6fa65b63c26b46777d4bf7 WatchSource:0}: Error finding container e45614c8aa741ba8190a78f1c1048acf10be7de1ea6fa65b63c26b46777d4bf7: Status 404 returned error can't find the container with id e45614c8aa741ba8190a78f1c1048acf10be7de1ea6fa65b63c26b46777d4bf7
Jul 16 21:51:32.063881 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.063739    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2"]
Jul 16 21:51:32.066365 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:51:32.066343    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92f6bd7_4915_4bd9_a35a_f419db791188.slice/crio-8ae4232f9f2983a7f741dd092ba8edfd1ca56261c69d0b2670712d155f65c005 WatchSource:0}: Error finding container 8ae4232f9f2983a7f741dd092ba8edfd1ca56261c69d0b2670712d155f65c005: Status 404 returned error can't find the container with id 8ae4232f9f2983a7f741dd092ba8edfd1ca56261c69d0b2670712d155f65c005
Jul 16 21:51:32.261494 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.261461    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdrzb" event={"ID":"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae","Type":"ContainerStarted","Data":"e45614c8aa741ba8190a78f1c1048acf10be7de1ea6fa65b63c26b46777d4bf7"}
Jul 16 21:51:32.263251 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.263218    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2" event={"ID":"d92f6bd7-4915-4bd9-a35a-f419db791188","Type":"ContainerStarted","Data":"05345f84b74cd66214e60bfb997b6fa68c9d9181c65f0d916e672cdc358d3e66"}
Jul 16 21:51:32.263361 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.263293    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2" event={"ID":"d92f6bd7-4915-4bd9-a35a-f419db791188","Type":"ContainerStarted","Data":"8ae4232f9f2983a7f741dd092ba8edfd1ca56261c69d0b2670712d155f65c005"}
Jul 16 21:51:32.312198 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.312166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:32.415851 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.415768    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:32.508836 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.508804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:32.606673 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.606643    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:32.684049 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:32.683971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:33.063593 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:33.063559    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:33.165241 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:33.165211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:33.269896 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:33.269855    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2" event={"ID":"d92f6bd7-4915-4bd9-a35a-f419db791188","Type":"ContainerStarted","Data":"5be87b0d1cffe918cff5c6c7979dd27b106e1c532b91409c2b2e81374ce03cd3"}
Jul 16 21:51:34.281344 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:34.281299    2569 generic.go:356] "Generic (PLEG): container finished" podID="29dc197d-55e1-4798-8ff5-13b4f3cbf6ae" containerID="369978f8821538bc030cb830500d071745aeec4cf35e0f80e05ef2c1e2f4fb0a" exitCode=0
Jul 16 21:51:34.281770 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:34.281674    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdrzb" event={"ID":"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae","Type":"ContainerDied","Data":"369978f8821538bc030cb830500d071745aeec4cf35e0f80e05ef2c1e2f4fb0a"}
Jul 16 21:51:34.284341 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:34.284317    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2" event={"ID":"d92f6bd7-4915-4bd9-a35a-f419db791188","Type":"ContainerStarted","Data":"454538f464341f1af19fc5c1dcff0aecc979a15bc32ad4c2b0bdd9cad893d8d6"}
Jul 16 21:51:34.317141 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:34.317108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:34.334388 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:34.334334    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hmcn2" podStartSLOduration=1.906744027 podStartE2EDuration="3.334314188s" totalImagesPullingTime="1.427570161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:34.333327679 +0000 UTC m=+93.863870406" watchObservedRunningTime="2026-07-16 21:51:34.334314188 +0000 UTC m=+93.864856915"
Jul 16 21:51:34.722296 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:34.722251    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:34.851252 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:34.851154    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:34.989394 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:34.989355    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:35.289988 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.289950    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdrzb" event={"ID":"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae","Type":"ContainerStarted","Data":"1654eb86cf0919a7f07e77d56ce367fb0da5234e10ee9439c89822bc59ccb7ba"}
Jul 16 21:51:35.290355 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.290020    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdrzb" event={"ID":"29dc197d-55e1-4798-8ff5-13b4f3cbf6ae","Type":"ContainerStarted","Data":"b673ad58e8f63031fe2df49f244de0c9c96cdf97eb2df5d8a8b581ea553302f6"}
Jul 16 21:51:35.328804 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.328757    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fdrzb" podStartSLOduration=2.660399172 podStartE2EDuration="4.328737231s" totalImagesPullingTime="1.574731882s" totalInitContainerRuntime="93.606177ms" isStatefulPod=true podCreationTimestamp="2026-07-16 21:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:35.327896696 +0000 UTC m=+94.858439422" watchObservedRunningTime="2026-07-16 21:51:35.328737231 +0000 UTC m=+94.859279964"
Jul 16 21:51:35.870314 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.870276    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7674b7d959-vwv5f"]
Jul 16 21:51:35.939242 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.939203    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7674b7d959-vwv5f"]
Jul 16 21:51:35.939428 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.939335    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:35.944349 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.944315    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 16 21:51:35.944496 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.944384    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 21:51:35.945081 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.945064    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d6addamu05e82\""
Jul 16 21:51:35.945966 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.945761    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 16 21:51:35.945966 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.945824    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 16 21:51:35.945966 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.945897    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8cjvc\""
Jul 16 21:51:35.999589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.999554    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9c6c23f-f129-4af4-9fce-5cd993574582-metrics-server-audit-profiles\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:35.999589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.999594    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-secret-metrics-server-client-certs\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:35.999816 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.999655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9c6c23f-f129-4af4-9fce-5cd993574582-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:35.999816 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.999696    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvhmz\" (UniqueName: \"kubernetes.io/projected/b9c6c23f-f129-4af4-9fce-5cd993574582-kube-api-access-bvhmz\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:35.999816 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.999740    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-secret-metrics-server-tls\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:35.999816 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.999773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-client-ca-bundle\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:35.999956 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:35.999827    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9c6c23f-f129-4af4-9fce-5cd993574582-audit-log\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.100706 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.100672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-secret-metrics-server-tls\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.100912 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.100723    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-client-ca-bundle\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.100912 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.100763    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9c6c23f-f129-4af4-9fce-5cd993574582-audit-log\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.100912 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.100789    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9c6c23f-f129-4af4-9fce-5cd993574582-metrics-server-audit-profiles\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.100912 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.100823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-secret-metrics-server-client-certs\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.100912 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.100875    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9c6c23f-f129-4af4-9fce-5cd993574582-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.100912 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.100904    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvhmz\" (UniqueName: \"kubernetes.io/projected/b9c6c23f-f129-4af4-9fce-5cd993574582-kube-api-access-bvhmz\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.101346 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.101315    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9c6c23f-f129-4af4-9fce-5cd993574582-audit-log\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.101743 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.101720    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9c6c23f-f129-4af4-9fce-5cd993574582-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.101894 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.101873    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9c6c23f-f129-4af4-9fce-5cd993574582-metrics-server-audit-profiles\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.103412 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.103385    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-secret-metrics-server-tls\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.103412 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.103407    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-client-ca-bundle\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.103649 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.103631    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9c6c23f-f129-4af4-9fce-5cd993574582-secret-metrics-server-client-certs\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.117280 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.117253    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvhmz\" (UniqueName: \"kubernetes.io/projected/b9c6c23f-f129-4af4-9fce-5cd993574582-kube-api-access-bvhmz\") pod \"metrics-server-7674b7d959-vwv5f\" (UID: \"b9c6c23f-f129-4af4-9fce-5cd993574582\") " pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.127422 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.127339    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"]
Jul 16 21:51:36.136351 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.136319    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:36.150193 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.150159    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"]
Jul 16 21:51:36.150336 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.150254    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:36.153207 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.153186    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-krn9t\""
Jul 16 21:51:36.153429 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.153414    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 16 21:51:36.248685 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.248644    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:36.303059 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.303026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e1d0ea8a-e323-46c8-82cb-20221d079dfc-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vzb8w\" (UID: \"e1d0ea8a-e323-46c8-82cb-20221d079dfc\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:36.303439 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.303129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx65f\" (UniqueName: \"kubernetes.io/projected/e1d0ea8a-e323-46c8-82cb-20221d079dfc-kube-api-access-xx65f\") pod \"monitoring-plugin-7b7b7bc8bf-vzb8w\" (UID: \"e1d0ea8a-e323-46c8-82cb-20221d079dfc\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:36.329099 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.329054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:36.398488 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.398416    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7674b7d959-vwv5f"]
Jul 16 21:51:36.401571 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:51:36.401544    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c6c23f_f129_4af4_9fce_5cd993574582.slice/crio-dad6be4dc82214bc2d9262b47e6bb1c37f070e96b9c125c430d8f8a43f20a605 WatchSource:0}: Error finding container dad6be4dc82214bc2d9262b47e6bb1c37f070e96b9c125c430d8f8a43f20a605: Status 404 returned error can't find the container with id dad6be4dc82214bc2d9262b47e6bb1c37f070e96b9c125c430d8f8a43f20a605
Jul 16 21:51:36.403543 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.403437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e1d0ea8a-e323-46c8-82cb-20221d079dfc-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vzb8w\" (UID: \"e1d0ea8a-e323-46c8-82cb-20221d079dfc\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:36.403713 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.403691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx65f\" (UniqueName: \"kubernetes.io/projected/e1d0ea8a-e323-46c8-82cb-20221d079dfc-kube-api-access-xx65f\") pod \"monitoring-plugin-7b7b7bc8bf-vzb8w\" (UID: \"e1d0ea8a-e323-46c8-82cb-20221d079dfc\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:36.405976 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.405958    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e1d0ea8a-e323-46c8-82cb-20221d079dfc-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vzb8w\" (UID: \"e1d0ea8a-e323-46c8-82cb-20221d079dfc\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:36.414210 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.414190    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx65f\" (UniqueName: \"kubernetes.io/projected/e1d0ea8a-e323-46c8-82cb-20221d079dfc-kube-api-access-xx65f\") pod \"monitoring-plugin-7b7b7bc8bf-vzb8w\" (UID: \"e1d0ea8a-e323-46c8-82cb-20221d079dfc\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:36.427544 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.427517    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:36.460153 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.460127    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:36.621155 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:36.621123    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"]
Jul 16 21:51:36.624203 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:51:36.624178    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d0ea8a_e323_46c8_82cb_20221d079dfc.slice/crio-89cedf055ebdd26d19c0e2f2806083854bed48a9ad89fc9a29522df12895f1ea WatchSource:0}: Error finding container 89cedf055ebdd26d19c0e2f2806083854bed48a9ad89fc9a29522df12895f1ea: Status 404 returned error can't find the container with id 89cedf055ebdd26d19c0e2f2806083854bed48a9ad89fc9a29522df12895f1ea
Jul 16 21:51:37.300360 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.300285    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f" event={"ID":"b9c6c23f-f129-4af4-9fce-5cd993574582","Type":"ContainerStarted","Data":"dad6be4dc82214bc2d9262b47e6bb1c37f070e96b9c125c430d8f8a43f20a605"}
Jul 16 21:51:37.301754 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.301719    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w" event={"ID":"e1d0ea8a-e323-46c8-82cb-20221d079dfc","Type":"ContainerStarted","Data":"89cedf055ebdd26d19c0e2f2806083854bed48a9ad89fc9a29522df12895f1ea"}
Jul 16 21:51:37.315976 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.315874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:37.421767 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.421731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:37.701822 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.701771    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:37.715433 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.715403    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:51:37.729286 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.729250    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.732934 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.732910    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 21:51:37.733087 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.732910    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 21:51:37.733303 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.733285    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 21:51:37.733406 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.733289    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 21:51:37.733406 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.733359    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 21:51:37.733601 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.733583    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 21:51:37.734729 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.734711    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 21:51:37.734947 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.734930    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h9dxm\""
Jul 16 21:51:37.735164 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.735146    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 21:51:37.735446 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.735416    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-56k6eq9iipsgq\""
Jul 16 21:51:37.738724 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.738490    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 21:51:37.738724 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.738491    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 21:51:37.738724 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.738522    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 21:51:37.740078 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.740060    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 21:51:37.749340 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.749315    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 21:51:37.750025 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.750001    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 21:51:37.760129 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.760099    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:51:37.814886 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.814848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.814886 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.814882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815096 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.814901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815096 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.814958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815096 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.814992    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815096 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815096 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815072    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-web-config\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815096 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815095    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815142    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e10cc099-53a7-44f7-8688-d9852eb6a879-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e10cc099-53a7-44f7-8688-d9852eb6a879-config-out\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815185    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815209    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-config\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815357    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.815560 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.815383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds2lg\" (UniqueName: \"kubernetes.io/projected/e10cc099-53a7-44f7-8688-d9852eb6a879-kube-api-access-ds2lg\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916428 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916647 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-web-config\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916647 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916484    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916647 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916822 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e10cc099-53a7-44f7-8688-d9852eb6a879-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916822 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916728    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e10cc099-53a7-44f7-8688-d9852eb6a879-config-out\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916822 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916822 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-config\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.916822 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916828    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916882    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.916974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917001    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds2lg\" (UniqueName: \"kubernetes.io/projected/e10cc099-53a7-44f7-8688-d9852eb6a879-kube-api-access-ds2lg\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917028    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917056    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917741 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917087    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917741 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917123    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917741 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917741 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917184    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917741 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917536    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.917741 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.917585    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.920050 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.920027    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.920460 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.920439    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e10cc099-53a7-44f7-8688-d9852eb6a879-config-out\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.920589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.920450    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.920946 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.920493    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.921470 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.921422    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.921470 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.921454    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-config\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.921650 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.921587    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e10cc099-53a7-44f7-8688-d9852eb6a879-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.921724 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.921668    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-web-config\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.922151 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.922125    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e10cc099-53a7-44f7-8688-d9852eb6a879-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.922634 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.922596    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.923142 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.923116    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.923230 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.923192    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.923763 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.923737    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.923850 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.923834    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.924224 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.924203    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e10cc099-53a7-44f7-8688-d9852eb6a879-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:37.931602 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:37.931569    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds2lg\" (UniqueName: \"kubernetes.io/projected/e10cc099-53a7-44f7-8688-d9852eb6a879-kube-api-access-ds2lg\") pod \"prometheus-k8s-0\" (UID: \"e10cc099-53a7-44f7-8688-d9852eb6a879\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:38.042055 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:38.041966    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:38.872788 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:38.872764    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:51:38.874715 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:51:38.874688    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10cc099_53a7_44f7_8688_d9852eb6a879.slice/crio-4e0fdc5d0034c83f21df1255cc2d820c98ded22a2c334f5292b2e6762f382ff7 WatchSource:0}: Error finding container 4e0fdc5d0034c83f21df1255cc2d820c98ded22a2c334f5292b2e6762f382ff7: Status 404 returned error can't find the container with id 4e0fdc5d0034c83f21df1255cc2d820c98ded22a2c334f5292b2e6762f382ff7
Jul 16 21:51:39.310166 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:39.310120    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e10cc099-53a7-44f7-8688-d9852eb6a879","Type":"ContainerStarted","Data":"4e0fdc5d0034c83f21df1255cc2d820c98ded22a2c334f5292b2e6762f382ff7"}
Jul 16 21:51:39.311656 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:39.311610    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f" event={"ID":"b9c6c23f-f129-4af4-9fce-5cd993574582","Type":"ContainerStarted","Data":"bf88d29250c39506c641f121e8d03849ddd4735ef3b61b9bc43839b96dc0489d"}
Jul 16 21:51:39.313013 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:39.312994    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w" event={"ID":"e1d0ea8a-e323-46c8-82cb-20221d079dfc","Type":"ContainerStarted","Data":"f9bf3ae52dcb532fab041203da45b5754a0d32a9f262d22ac800d180cc32c77a"}
Jul 16 21:51:39.313225 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:39.313196    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:39.317991 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:39.317970    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w"
Jul 16 21:51:39.338059 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:39.338002    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f" podStartSLOduration=2.019876701 podStartE2EDuration="4.337987215s" totalImagesPullingTime="2.318110514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:39.337676071 +0000 UTC m=+98.868218797" watchObservedRunningTime="2026-07-16 21:51:39.337987215 +0000 UTC m=+98.868529942"
Jul 16 21:51:39.368182 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:39.368122    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vzb8w" podStartSLOduration=1.270054466 podStartE2EDuration="3.368098667s" totalImagesPullingTime="2.098044201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:39.366758544 +0000 UTC m=+98.897301271" watchObservedRunningTime="2026-07-16 21:51:39.368098667 +0000 UTC m=+98.898641396"
Jul 16 21:51:40.318119 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:40.318024    2569 generic.go:356] "Generic (PLEG): container finished" podID="e10cc099-53a7-44f7-8688-d9852eb6a879" containerID="e9f9dd1e74b8a7b542353eea8c4eff3af672b3540ef5e27b5e23d241405a3ef3" exitCode=0
Jul 16 21:51:40.318546 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:40.318115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e10cc099-53a7-44f7-8688-d9852eb6a879","Type":"ContainerDied","Data":"e9f9dd1e74b8a7b542353eea8c4eff3af672b3540ef5e27b5e23d241405a3ef3"}
Jul 16 21:51:43.333264 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:43.333233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e10cc099-53a7-44f7-8688-d9852eb6a879","Type":"ContainerStarted","Data":"be83eef0ecc4f37127b89e2b41b4f6f7290582122a388a9e2dcd72be9064714f"}
Jul 16 21:51:43.333613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:43.333298    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e10cc099-53a7-44f7-8688-d9852eb6a879","Type":"ContainerStarted","Data":"4b8852a7fd7ec31d182899ea6b18c655f2af00c924dfed51912c4e9ceb843def"}
Jul 16 21:51:45.203650 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.203605    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9pgl5"
Jul 16 21:51:45.304712 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.304679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:45.344402 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.344366    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e10cc099-53a7-44f7-8688-d9852eb6a879","Type":"ContainerStarted","Data":"2ff75f0be8c680cad0065f96802e68672f6d6b478bf5e31cc279d66086d49e70"}
Jul 16 21:51:45.344589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.344449    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e10cc099-53a7-44f7-8688-d9852eb6a879","Type":"ContainerStarted","Data":"986f59dbc123f2f32b975749cf7ae14d8305f43ba9f48232255d838998a7d8ae"}
Jul 16 21:51:45.344589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.344494    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e10cc099-53a7-44f7-8688-d9852eb6a879","Type":"ContainerStarted","Data":"87363d5e4a936a0ff7f27b8ed0b8f3115021a7f80e9a02ad723bead85abde2fc"}
Jul 16 21:51:45.344589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.344546    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e10cc099-53a7-44f7-8688-d9852eb6a879","Type":"ContainerStarted","Data":"f88bb5170b1c4224d5ace1e23e84d53f6311bf931427ff7f9e1a5d6ef93a751b"}
Jul 16 21:51:45.399586 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.399505    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7642031559999998 podStartE2EDuration="8.399483276s" totalImagesPullingTime="5.617695579s" totalInitContainerRuntime="17.584541ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:45.396179137 +0000 UTC m=+104.926721894" watchObservedRunningTime="2026-07-16 21:51:45.399483276 +0000 UTC m=+104.930026005"
Jul 16 21:51:45.442402 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.442368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:45.563755 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:45.563674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:47.766329 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:47.766292    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:47.923302 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:47.923267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:48.042785 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:48.042694    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:52.235773 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:52.235737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:52.330361 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:52.330326    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:52.409980 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:52.409950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:56.248845 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:56.248789    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:56.249254 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:56.248898    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:51:58.845029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:51:58.844994    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:08.728924 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:08.728883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:08.811020 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:08.810988    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:16.254414 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:16.254378    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:52:16.258437 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:16.258410    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7674b7d959-vwv5f"
Jul 16 21:52:38.042173 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:38.042128    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:52:38.060728 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:38.060703    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:52:38.549788 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:38.549753    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:52:47.552265 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:47.552234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:47.634291 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:47.634248    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:54.072293 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:54.072220    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:54.172926 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:54.172897    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:54.274607 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:54.274564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:54.609424 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:54.609395    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:54.710537 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:54.710512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:59.468994 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:59.468956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:59.551902 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:52:59.551866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:02.711422 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:02.711387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:02.809980 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:02.809946    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:05.412161 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:05.412105    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:05.559666 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:05.559609    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:32.894530 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:32.894499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:32.972136 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:32.972089    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:43.708556 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:43.708522    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:43.977234 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:43.977153    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:44.078046 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:44.078015    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:44.239428 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:44.239348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:44.303068 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:44.303040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:44.376051 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:53:44.376018    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:06.484299 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:06.484266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:06.591906 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:06.591870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:12.302363 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:12.302326    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:12.577298 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:12.577182    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:12.723885 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:12.723828    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:12.807399 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:12.807363    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:12.901903 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:12.901818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:13.436043 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:13.436013    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:13.719029 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:13.718999    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:13.826344 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:13.826312    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:13.918453 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:13.918421    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:14.236077 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:14.236044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:14.537207 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:14.537122    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:14.739075 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:14.739037    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:14.839545 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:14.839459    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:18.788441 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:18.788404    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:18.873347 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:54:18.873314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:00.785642 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:55:00.785601    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 21:55:21.101967 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:55:21.101931    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:22.614165 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:55:22.614131    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:04.672466 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:04.672362    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:04.777678 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:04.777639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:15.931371 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:15.931307    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:16.732836 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:16.732803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:19.797067 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:19.797028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:19.935051 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:19.935012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:22.271099 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:22.271062    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:22.504693 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:22.504661    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:24.599925 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:24.599892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:24.850885 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:24.850795    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:25.008813 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:25.008784    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:25.319286 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:25.319246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:26.378161 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:26.378127    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:26.601070 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:26.601031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:33.154362 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:33.154318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:38.282803 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:38.282761    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:38.384649 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:38.384601    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:39.774420 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.774377    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"]
Jul 16 21:56:39.778400 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.778374    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"
Jul 16 21:56:39.781683 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.781664    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:56:39.782947 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.782928    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 21:56:39.783030 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.782948    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fzml5\""
Jul 16 21:56:39.790364 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.790340    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"]
Jul 16 21:56:39.819924 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.819890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/197d7cee-d752-4a0c-a7ac-097a40b79771-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m74bm\" (UID: \"197d7cee-d752-4a0c-a7ac-097a40b79771\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"
Jul 16 21:56:39.820081 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.819931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hpsx\" (UniqueName: \"kubernetes.io/projected/197d7cee-d752-4a0c-a7ac-097a40b79771-kube-api-access-4hpsx\") pod \"openshift-lws-operator-fd8ccff4c-m74bm\" (UID: \"197d7cee-d752-4a0c-a7ac-097a40b79771\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"
Jul 16 21:56:39.920372 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.920337    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/197d7cee-d752-4a0c-a7ac-097a40b79771-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m74bm\" (UID: \"197d7cee-d752-4a0c-a7ac-097a40b79771\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"
Jul 16 21:56:39.920372 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.920375    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hpsx\" (UniqueName: \"kubernetes.io/projected/197d7cee-d752-4a0c-a7ac-097a40b79771-kube-api-access-4hpsx\") pod \"openshift-lws-operator-fd8ccff4c-m74bm\" (UID: \"197d7cee-d752-4a0c-a7ac-097a40b79771\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"
Jul 16 21:56:39.920859 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.920836    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/197d7cee-d752-4a0c-a7ac-097a40b79771-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m74bm\" (UID: \"197d7cee-d752-4a0c-a7ac-097a40b79771\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"
Jul 16 21:56:39.930025 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:39.929997    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hpsx\" (UniqueName: \"kubernetes.io/projected/197d7cee-d752-4a0c-a7ac-097a40b79771-kube-api-access-4hpsx\") pod \"openshift-lws-operator-fd8ccff4c-m74bm\" (UID: \"197d7cee-d752-4a0c-a7ac-097a40b79771\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"
Jul 16 21:56:40.086661 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:40.086544    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"
Jul 16 21:56:40.216283 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:40.216248    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm"]
Jul 16 21:56:40.219654 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:56:40.219610    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod197d7cee_d752_4a0c_a7ac_097a40b79771.slice/crio-084bd20b63b3d200e09e437ef4fc5a56867e7835b7d9b228ba03fec924e4cce0 WatchSource:0}: Error finding container 084bd20b63b3d200e09e437ef4fc5a56867e7835b7d9b228ba03fec924e4cce0: Status 404 returned error can't find the container with id 084bd20b63b3d200e09e437ef4fc5a56867e7835b7d9b228ba03fec924e4cce0
Jul 16 21:56:40.221347 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:40.221328    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:56:40.386905 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:40.386820    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm" event={"ID":"197d7cee-d752-4a0c-a7ac-097a40b79771","Type":"ContainerStarted","Data":"084bd20b63b3d200e09e437ef4fc5a56867e7835b7d9b228ba03fec924e4cce0"}
Jul 16 21:56:43.402315 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:43.402276    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm" event={"ID":"197d7cee-d752-4a0c-a7ac-097a40b79771","Type":"ContainerStarted","Data":"015e3a51b4d4ff51ba95d0995eeb2b91f5b546cadf8f9fa6eaaa5dfb90cccd85"}
Jul 16 21:56:43.432465 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:43.432414    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m74bm" podStartSLOduration=1.948549235 podStartE2EDuration="4.432399301s" totalImagesPullingTime="2.483850066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:56:43.432147537 +0000 UTC m=+402.962690263" watchObservedRunningTime="2026-07-16 21:56:43.432399301 +0000 UTC m=+402.962942027"
Jul 16 21:56:44.433601 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:44.433564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:44.536320 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:44.536281    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:49.808348 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:49.808308    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:50.285701 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:50.285667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:50.430148 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:50.430107    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:56.723855 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:56.723816    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:56.971102 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:56.971069    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:59.324971 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:56:59.324941    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:00.451420 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:00.451383    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:00.626418 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:00.626384    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:01.611317 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:01.611256    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:01.866689 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:01.866568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:03.812141 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.812085    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"]
Jul 16 21:57:03.815431 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.815411    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.819720 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.819701    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 21:57:03.820099 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.820083    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 21:57:03.820913 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.820895    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 21:57:03.835755 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.835723    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-2fjjm\""
Jul 16 21:57:03.850778 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.850749    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"]
Jul 16 21:57:03.930929 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.930895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fl9d\" (UniqueName: \"kubernetes.io/projected/bbda7512-284e-4616-afce-15030d362dc2-kube-api-access-2fl9d\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.930929 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.930933    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.931154 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.930964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbda7512-284e-4616-afce-15030d362dc2-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.931154 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.930999    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.931154 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.931057    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.931154 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.931072    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbda7512-284e-4616-afce-15030d362dc2-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.931154 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.931115    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.931315 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.931164    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.931315 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.931185    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbda7512-284e-4616-afce-15030d362dc2-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:03.998286 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:03.998258    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:04.032408 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032408 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032412    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbda7512-284e-4616-afce-15030d362dc2-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032649 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032432    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fl9d\" (UniqueName: \"kubernetes.io/projected/bbda7512-284e-4616-afce-15030d362dc2-kube-api-access-2fl9d\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032649 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032561    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032649 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbda7512-284e-4616-afce-15030d362dc2-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032875 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032840    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032875 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032869    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbda7512-284e-4616-afce-15030d362dc2-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032986 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032891    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.032986 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.032951    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.033094 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.033062    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.033184 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.033156    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.033345 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.033314    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.033599 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.033580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbda7512-284e-4616-afce-15030d362dc2-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.034963 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.034936    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbda7512-284e-4616-afce-15030d362dc2-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.035169 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.035152    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbda7512-284e-4616-afce-15030d362dc2-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.044707 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.044659    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbda7512-284e-4616-afce-15030d362dc2-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.047868 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.047842    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fl9d\" (UniqueName: \"kubernetes.io/projected/bbda7512-284e-4616-afce-15030d362dc2-kube-api-access-2fl9d\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-lcjkw\" (UID: \"bbda7512-284e-4616-afce-15030d362dc2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.125702 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.125663    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:04.150360 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.150314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:04.297119 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.297093    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"]
Jul 16 21:57:04.298362 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:57:04.298337    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbda7512_284e_4616_afce_15030d362dc2.slice/crio-6dad39b0e0afdc1f29ecfe5e8f7c06c6adf3e97f5032db50edab7b6e1547b610 WatchSource:0}: Error finding container 6dad39b0e0afdc1f29ecfe5e8f7c06c6adf3e97f5032db50edab7b6e1547b610: Status 404 returned error can't find the container with id 6dad39b0e0afdc1f29ecfe5e8f7c06c6adf3e97f5032db50edab7b6e1547b610
Jul 16 21:57:04.479895 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:04.479863    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" event={"ID":"bbda7512-284e-4616-afce-15030d362dc2","Type":"ContainerStarted","Data":"6dad39b0e0afdc1f29ecfe5e8f7c06c6adf3e97f5032db50edab7b6e1547b610"}
Jul 16 21:57:07.257589 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:07.257542    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 21:57:07.257948 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:07.257631    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 21:57:07.257948 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:07.257665    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 21:57:07.449020 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:07.448991    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:07.493686 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:07.493656    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" event={"ID":"bbda7512-284e-4616-afce-15030d362dc2","Type":"ContainerStarted","Data":"a8c8a843d65b3f2c8308f986e9d7b261596912072e0208e77c7df9bce8de39fb"}
Jul 16 21:57:07.531026 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:07.530924    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" podStartSLOduration=1.574075366 podStartE2EDuration="4.530905071s" totalImagesPullingTime="2.956829705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:07.528472377 +0000 UTC m=+427.059015104" watchObservedRunningTime="2026-07-16 21:57:07.530905071 +0000 UTC m=+427.061447798"
Jul 16 21:57:08.126699 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:08.126665    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:08.131206 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:08.131175    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:08.497346 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:08.497302    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:08.498424 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:08.498409    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 21:57:11.298878 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:11.298844    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:11.408425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:11.408391    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:18.112517 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.112481    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:18.165193 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.165157    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"]
Jul 16 21:57:18.170936 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.170912    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.174957 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.174931    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 21:57:18.175089 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.174935    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 21:57:18.175089 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.175000    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hcdd7\""
Jul 16 21:57:18.175089 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.175032    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 21:57:18.179980 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.179959    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"]
Jul 16 21:57:18.207337 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.207281    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:18.251855 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.251817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-cert\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.252061 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.251867    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r47v\" (UniqueName: \"kubernetes.io/projected/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-kube-api-access-8r47v\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.252061 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.251903    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-metrics-cert\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.252061 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.251979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-manager-config\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.352414 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.352372    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-metrics-cert\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.352613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.352430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-manager-config\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.352613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.352473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-cert\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.352613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.352500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r47v\" (UniqueName: \"kubernetes.io/projected/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-kube-api-access-8r47v\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.353342 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.353319    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-manager-config\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.355049 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.355032    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-cert\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.355122 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.355058    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-metrics-cert\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.371639 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.371559    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r47v\" (UniqueName: \"kubernetes.io/projected/61c1cbb7-aff8-4110-b141-5ee3a1cb443f-kube-api-access-8r47v\") pod \"lws-controller-manager-5fcdcd6776-g4j7q\" (UID: \"61c1cbb7-aff8-4110-b141-5ee3a1cb443f\") " pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.480875 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.480831    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:18.615129 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:18.615098    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"]
Jul 16 21:57:18.618373 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:57:18.618349    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c1cbb7_aff8_4110_b141_5ee3a1cb443f.slice/crio-813fdac580db9fe434f18a6ec34a5ba1d3886e2ea3108480fe1445326b9621c6 WatchSource:0}: Error finding container 813fdac580db9fe434f18a6ec34a5ba1d3886e2ea3108480fe1445326b9621c6: Status 404 returned error can't find the container with id 813fdac580db9fe434f18a6ec34a5ba1d3886e2ea3108480fe1445326b9621c6
Jul 16 21:57:19.540789 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:19.540750    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q" event={"ID":"61c1cbb7-aff8-4110-b141-5ee3a1cb443f","Type":"ContainerStarted","Data":"813fdac580db9fe434f18a6ec34a5ba1d3886e2ea3108480fe1445326b9621c6"}
Jul 16 21:57:20.546281 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:20.546246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q" event={"ID":"61c1cbb7-aff8-4110-b141-5ee3a1cb443f","Type":"ContainerStarted","Data":"5ec3fee979a5e5cbdec815cb3cd44b3acb039682445e776f925105e4220b0648"}
Jul 16 21:57:20.546719 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:20.546367    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:20.569850 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:20.569805    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q" podStartSLOduration=1.089485404 podStartE2EDuration="2.569790295s" totalImagesPullingTime="1.480304891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:20.568468135 +0000 UTC m=+440.099010862" watchObservedRunningTime="2026-07-16 21:57:20.569790295 +0000 UTC m=+440.100333021"
Jul 16 21:57:24.533812 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:24.533731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:27.533804 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:27.533765    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:27.885272 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:27.885181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:28.315956 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:28.315925    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:29.799171 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:29.799138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:30.866854 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:30.866820    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:31.090757 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:31.090719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:31.552726 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:31.552694    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5fcdcd6776-g4j7q"
Jul 16 21:57:31.834906 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:31.834800    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:32.164502 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:32.164404    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:32.332876 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:32.332831    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:32.456728 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:32.456695    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:34.317597 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.317566    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-97wxk"]
Jul 16 21:57:34.320870 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.320855    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-97wxk"
Jul 16 21:57:34.323913 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.323896    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 21:57:34.324277 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.324247    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 21:57:34.324384 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.324362    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kjqvn\""
Jul 16 21:57:34.333267 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.333242    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-97wxk"]
Jul 16 21:57:34.392415 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.392380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2944\" (UniqueName: \"kubernetes.io/projected/9b6ba87a-5fb4-4612-9a32-467129f0c6fd-kube-api-access-q2944\") pod \"authorino-operator-6d85f6564-97wxk\" (UID: \"9b6ba87a-5fb4-4612-9a32-467129f0c6fd\") " pod="kuadrant-system/authorino-operator-6d85f6564-97wxk"
Jul 16 21:57:34.493401 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.493366    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2944\" (UniqueName: \"kubernetes.io/projected/9b6ba87a-5fb4-4612-9a32-467129f0c6fd-kube-api-access-q2944\") pod \"authorino-operator-6d85f6564-97wxk\" (UID: \"9b6ba87a-5fb4-4612-9a32-467129f0c6fd\") " pod="kuadrant-system/authorino-operator-6d85f6564-97wxk"
Jul 16 21:57:34.502815 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.502784    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2944\" (UniqueName: \"kubernetes.io/projected/9b6ba87a-5fb4-4612-9a32-467129f0c6fd-kube-api-access-q2944\") pod \"authorino-operator-6d85f6564-97wxk\" (UID: \"9b6ba87a-5fb4-4612-9a32-467129f0c6fd\") " pod="kuadrant-system/authorino-operator-6d85f6564-97wxk"
Jul 16 21:57:34.630612 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.630509    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-97wxk"
Jul 16 21:57:34.771002 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.770976    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-97wxk"]
Jul 16 21:57:34.772916 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:57:34.772876    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6ba87a_5fb4_4612_9a32_467129f0c6fd.slice/crio-cbb7ca3f127ea5ae8f207da82ecd3d9731522e173a3eea4023e511dbaa19c2aa WatchSource:0}: Error finding container cbb7ca3f127ea5ae8f207da82ecd3d9731522e173a3eea4023e511dbaa19c2aa: Status 404 returned error can't find the container with id cbb7ca3f127ea5ae8f207da82ecd3d9731522e173a3eea4023e511dbaa19c2aa
Jul 16 21:57:34.855567 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:34.855521    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:35.613033 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:35.612995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-97wxk" event={"ID":"9b6ba87a-5fb4-4612-9a32-467129f0c6fd","Type":"ContainerStarted","Data":"cbb7ca3f127ea5ae8f207da82ecd3d9731522e173a3eea4023e511dbaa19c2aa"}
Jul 16 21:57:35.907822 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:35.907739    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:37.622608 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:37.622571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-97wxk" event={"ID":"9b6ba87a-5fb4-4612-9a32-467129f0c6fd","Type":"ContainerStarted","Data":"e26c9246dd33bb40c814764651081cca55ffb842e43366a1e93dd36bd996f187"}
Jul 16 21:57:37.622990 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:37.622663    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d85f6564-97wxk"
Jul 16 21:57:37.666344 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:37.666291    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d85f6564-97wxk" podStartSLOduration=1.251926729 podStartE2EDuration="3.666274234s" totalImagesPullingTime="2.414347505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:37.664379225 +0000 UTC m=+457.194921965" watchObservedRunningTime="2026-07-16 21:57:37.666274234 +0000 UTC m=+457.196816961"
Jul 16 21:57:37.885335 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:37.885252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:37.992194 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:37.992160    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:41.824613 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:41.824570    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:41.928250 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:41.928214    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:42.251545 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:42.251500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:42.354799 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:42.354767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:42.695885 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:42.695798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:42.843419 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:42.843377    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:43.923403 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:43.923369    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:44.024280 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:44.024249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:45.777459 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:45.777430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:48.629785 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:48.629750    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d85f6564-97wxk"
Jul 16 21:57:50.341295 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:50.341265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:50.444383 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:50.444344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:52.790522 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:52.790493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:52.890112 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:52.890027    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:55.171307 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:55.171275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:55.292582 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:55.292554    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:57.112449 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:57.112415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:57.211047 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:57:57.211012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:00.904446 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:00.904411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:01.006355 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:01.006317    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:01.104913 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:01.104861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:01.205544 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:01.205490    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:02.102748 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:02.102716    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:02.203564 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:02.203531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:11.312266 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:11.312230    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:11.406463 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:11.406429    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:13.836757 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:13.836724    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:13.913162 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:13.913124    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:24.053236 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:24.053201    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:24.214404 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:24.214371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:25.011932 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.011900    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b6c89bb85-5xw9l"]
Jul 16 21:58:25.015005 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.014983    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-5xw9l"
Jul 16 21:58:25.018719 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.018696    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hjvdh\""
Jul 16 21:58:25.026243 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.026218    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-5xw9l"]
Jul 16 21:58:25.133690 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.133655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzvx4\" (UniqueName: \"kubernetes.io/projected/efe1e43e-5262-4c9b-be68-16142e687bc4-kube-api-access-hzvx4\") pod \"authorino-b6c89bb85-5xw9l\" (UID: \"efe1e43e-5262-4c9b-be68-16142e687bc4\") " pod="kuadrant-system/authorino-b6c89bb85-5xw9l"
Jul 16 21:58:25.197898 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.197864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:25.238914 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.238856    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzvx4\" (UniqueName: \"kubernetes.io/projected/efe1e43e-5262-4c9b-be68-16142e687bc4-kube-api-access-hzvx4\") pod \"authorino-b6c89bb85-5xw9l\" (UID: \"efe1e43e-5262-4c9b-be68-16142e687bc4\") " pod="kuadrant-system/authorino-b6c89bb85-5xw9l"
Jul 16 21:58:25.249743 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.249711    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzvx4\" (UniqueName: \"kubernetes.io/projected/efe1e43e-5262-4c9b-be68-16142e687bc4-kube-api-access-hzvx4\") pod \"authorino-b6c89bb85-5xw9l\" (UID: \"efe1e43e-5262-4c9b-be68-16142e687bc4\") " pod="kuadrant-system/authorino-b6c89bb85-5xw9l"
Jul 16 21:58:25.323425 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.323345    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-5xw9l"
Jul 16 21:58:25.462022 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.461986    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-5xw9l"]
Jul 16 21:58:25.464999 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:58:25.464954    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefe1e43e_5262_4c9b_be68_16142e687bc4.slice/crio-397760b36fbb17cac31a9596e74c5ca6b143f1c1e40d0456626237579ee2d70e WatchSource:0}: Error finding container 397760b36fbb17cac31a9596e74c5ca6b143f1c1e40d0456626237579ee2d70e: Status 404 returned error can't find the container with id 397760b36fbb17cac31a9596e74c5ca6b143f1c1e40d0456626237579ee2d70e
Jul 16 21:58:25.801332 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:25.801297    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-5xw9l" event={"ID":"efe1e43e-5262-4c9b-be68-16142e687bc4","Type":"ContainerStarted","Data":"397760b36fbb17cac31a9596e74c5ca6b143f1c1e40d0456626237579ee2d70e"}
Jul 16 21:58:26.192507 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:26.192419    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:28.815722 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:28.815682    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-5xw9l" event={"ID":"efe1e43e-5262-4c9b-be68-16142e687bc4","Type":"ContainerStarted","Data":"57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e"}
Jul 16 21:58:28.832331 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:28.832272    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b6c89bb85-5xw9l" podStartSLOduration=2.294196325 podStartE2EDuration="4.832255784s" totalImagesPullingTime="2.538059459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:28.831128188 +0000 UTC m=+508.361670916" watchObservedRunningTime="2026-07-16 21:58:28.832255784 +0000 UTC m=+508.362798510"
Jul 16 21:58:29.637756 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:29.637718    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-5xw9l"]
Jul 16 21:58:30.824053 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:30.824016    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b6c89bb85-5xw9l" podUID="efe1e43e-5262-4c9b-be68-16142e687bc4" containerName="authorino" containerID="cri-o://57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e" gracePeriod=30
Jul 16 21:58:31.071174 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.071152    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-5xw9l"
Jul 16 21:58:31.189078 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.188986    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzvx4\" (UniqueName: \"kubernetes.io/projected/efe1e43e-5262-4c9b-be68-16142e687bc4-kube-api-access-hzvx4\") pod \"efe1e43e-5262-4c9b-be68-16142e687bc4\" (UID: \"efe1e43e-5262-4c9b-be68-16142e687bc4\") "
Jul 16 21:58:31.191148 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.191113    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe1e43e-5262-4c9b-be68-16142e687bc4-kube-api-access-hzvx4" (OuterVolumeSpecName: "kube-api-access-hzvx4") pod "efe1e43e-5262-4c9b-be68-16142e687bc4" (UID: "efe1e43e-5262-4c9b-be68-16142e687bc4"). InnerVolumeSpecName "kube-api-access-hzvx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:58:31.289999 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.289963    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzvx4\" (UniqueName: \"kubernetes.io/projected/efe1e43e-5262-4c9b-be68-16142e687bc4-kube-api-access-hzvx4\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 21:58:31.829361 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.829320    2569 generic.go:356] "Generic (PLEG): container finished" podID="efe1e43e-5262-4c9b-be68-16142e687bc4" containerID="57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e" exitCode=0
Jul 16 21:58:31.829778 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.829386    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-5xw9l"
Jul 16 21:58:31.829778 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.829387    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-5xw9l" event={"ID":"efe1e43e-5262-4c9b-be68-16142e687bc4","Type":"ContainerDied","Data":"57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e"}
Jul 16 21:58:31.829778 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.829427    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-5xw9l" event={"ID":"efe1e43e-5262-4c9b-be68-16142e687bc4","Type":"ContainerDied","Data":"397760b36fbb17cac31a9596e74c5ca6b143f1c1e40d0456626237579ee2d70e"}
Jul 16 21:58:31.829778 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.829449    2569 scope.go:117] "RemoveContainer" containerID="57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e"
Jul 16 21:58:31.838182 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.838161    2569 scope.go:117] "RemoveContainer" containerID="57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e"
Jul 16 21:58:31.838438 ip-10-0-135-126 kubenswrapper[2569]: E0716 21:58:31.838417    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e\": container with ID starting with 57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e not found: ID does not exist" containerID="57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e"
Jul 16 21:58:31.838486 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.838447    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e"} err="failed to get container status \"57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e\": rpc error: code = NotFound desc = could not find container \"57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e\": container with ID starting with 57c19be0d960d1819daeba1289fae90859e9bfea54a38aa277d6c79f11776d7e not found: ID does not exist"
Jul 16 21:58:31.851864 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.851835    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-5xw9l"]
Jul 16 21:58:31.853901 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:31.853882    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-5xw9l"]
Jul 16 21:58:32.901469 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:32.901436    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe1e43e-5262-4c9b-be68-16142e687bc4" path="/var/lib/kubelet/pods/efe1e43e-5262-4c9b-be68-16142e687bc4/volumes"
Jul 16 21:58:46.104073 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:46.104035    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:46.346186 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:58:46.346152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:31.168541 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.168509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:31.231875 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.231851    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zz9wz"]
Jul 16 21:59:31.232144 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.232132    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe1e43e-5262-4c9b-be68-16142e687bc4" containerName="authorino"
Jul 16 21:59:31.232191 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.232146    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe1e43e-5262-4c9b-be68-16142e687bc4" containerName="authorino"
Jul 16 21:59:31.232227 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.232200    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe1e43e-5262-4c9b-be68-16142e687bc4" containerName="authorino"
Jul 16 21:59:31.235054 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.235039    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:31.239299 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.239278    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 16 21:59:31.239965 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.239943    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-2lgrx\""
Jul 16 21:59:31.239965 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.239951    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 16 21:59:31.240104 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.239951    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 16 21:59:31.256281 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.256255    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zz9wz"]
Jul 16 21:59:31.299275 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.299252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:31.377105 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.377082    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh7lw\" (UniqueName: \"kubernetes.io/projected/9296a2ca-cfa6-4589-83b0-0eca1ddde049-kube-api-access-sh7lw\") pod \"odh-model-controller-84b54b7f97-zz9wz\" (UID: \"9296a2ca-cfa6-4589-83b0-0eca1ddde049\") " pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:31.377233 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.377118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9296a2ca-cfa6-4589-83b0-0eca1ddde049-cert\") pod \"odh-model-controller-84b54b7f97-zz9wz\" (UID: \"9296a2ca-cfa6-4589-83b0-0eca1ddde049\") " pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:31.442431 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.442347    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:31.478502 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.478481    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh7lw\" (UniqueName: \"kubernetes.io/projected/9296a2ca-cfa6-4589-83b0-0eca1ddde049-kube-api-access-sh7lw\") pod \"odh-model-controller-84b54b7f97-zz9wz\" (UID: \"9296a2ca-cfa6-4589-83b0-0eca1ddde049\") " pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:31.478583 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.478511    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9296a2ca-cfa6-4589-83b0-0eca1ddde049-cert\") pod \"odh-model-controller-84b54b7f97-zz9wz\" (UID: \"9296a2ca-cfa6-4589-83b0-0eca1ddde049\") " pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:31.480796 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.480777    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9296a2ca-cfa6-4589-83b0-0eca1ddde049-cert\") pod \"odh-model-controller-84b54b7f97-zz9wz\" (UID: \"9296a2ca-cfa6-4589-83b0-0eca1ddde049\") " pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:31.491062 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.491036    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh7lw\" (UniqueName: \"kubernetes.io/projected/9296a2ca-cfa6-4589-83b0-0eca1ddde049-kube-api-access-sh7lw\") pod \"odh-model-controller-84b54b7f97-zz9wz\" (UID: \"9296a2ca-cfa6-4589-83b0-0eca1ddde049\") " pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:31.545027 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.545002    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:31.705442 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:31.705415    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-zz9wz"]
Jul 16 21:59:31.706425 ip-10-0-135-126 kubenswrapper[2569]: W0716 21:59:31.706401    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9296a2ca_cfa6_4589_83b0_0eca1ddde049.slice/crio-69ad5fb8c2536d8c4d9af5d9112577c2b9865b16456400b2980b5c757f467bdb WatchSource:0}: Error finding container 69ad5fb8c2536d8c4d9af5d9112577c2b9865b16456400b2980b5c757f467bdb: Status 404 returned error can't find the container with id 69ad5fb8c2536d8c4d9af5d9112577c2b9865b16456400b2980b5c757f467bdb
Jul 16 21:59:32.054364 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:32.054291    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-zz9wz" event={"ID":"9296a2ca-cfa6-4589-83b0-0eca1ddde049","Type":"ContainerStarted","Data":"69ad5fb8c2536d8c4d9af5d9112577c2b9865b16456400b2980b5c757f467bdb"}
Jul 16 21:59:32.129484 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:32.129450    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:32.239807 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:32.239773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:35.067811 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:35.067772    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-zz9wz" event={"ID":"9296a2ca-cfa6-4589-83b0-0eca1ddde049","Type":"ContainerStarted","Data":"2783fd6e2f328cfd9b4082d8f9f22fb5ffbd2a8d5b4f1e9421710d202dd8c108"}
Jul 16 21:59:35.068280 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:35.067874    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:35.087528 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:35.087470    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-zz9wz" podStartSLOduration=1.402757379 podStartE2EDuration="4.087455977s" totalImagesPullingTime="2.684698598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:59:35.086214236 +0000 UTC m=+574.616756964" watchObservedRunningTime="2026-07-16 21:59:35.087455977 +0000 UTC m=+574.617998738"
Jul 16 21:59:41.344037 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:41.344002    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:46.073924 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:46.073896    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-zz9wz"
Jul 16 21:59:58.522532 ip-10-0-135-126 kubenswrapper[2569]: I0716 21:59:58.522494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:27.620165 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:00:27.620089    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:39.357437 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:00:39.357400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:55.908291 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:00:55.908254    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:55.988079 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:00:55.988047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:04.706097 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:04.706059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:04.802075 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:04.802037    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:17.469357 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.469321    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"]
Jul 16 22:01:17.472912 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.472898    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.476379 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.476354    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-46kg6\""
Jul 16 22:01:17.476841 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.476820    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 22:01:17.477136 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.477121    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 16 22:01:17.479836 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.479812    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 22:01:17.487133 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.487111    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:17.577639 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.577585    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"]
Jul 16 22:01:17.591680 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591649    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.591855 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.591855 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591742    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.591855 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.591855 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591806    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.592023 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591863    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjv44\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-kube-api-access-kjv44\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.592023 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591908    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.592023 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591941    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.592023 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.591971    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.616735 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.616702    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:17.692503 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.692503 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692462    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv44\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-kube-api-access-kjv44\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.692503 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.692503 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692503    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.692850 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.692850 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.692850 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692630    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.692850 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.692850 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692701    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.693094 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.692962    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.693216 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.693194    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.693694 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.693542    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.693812 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.693787    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.693906 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.693650    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.695772 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.695749    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.695951 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.695931    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.707980 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.707948    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"]
Jul 16 22:01:17.709496 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.709472    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjv44\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-kube-api-access-kjv44\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.709972 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.709956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-8zpjr\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.714200 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.714185    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.727634 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.727590    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"]
Jul 16 22:01:17.784916 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.784883    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:17.793973 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.793946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.794092 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.793990    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.794092 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.794033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.794177 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.794122    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7tkt\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-kube-api-access-p7tkt\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.794233 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.794213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.794268 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.794242    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.794305 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.794267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.794305 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.794293    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.794373 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.794330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895030 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.894999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895030 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895267 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895267 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895267 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895244    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895432 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895310    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895432 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895347    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895432 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895410    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895583 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895443    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7tkt\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-kube-api-access-p7tkt\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.895673 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.895585    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.896158 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.896129    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.896386 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.896363    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.896468 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.896435    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.896528 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.896460    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.897680 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.897658    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.897893 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.897874    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.903906 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.903878    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.904046 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.904029    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7tkt\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-kube-api-access-p7tkt\") pod \"router-gateway-1-openshift-default-54c47cdfc7-7cwwt\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:17.922408 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.922384    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"]
Jul 16 22:01:17.923650 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:01:17.923601    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7f4889_f004_43c0_9b6f_d0674bdfbf3e.slice/crio-b0573bd48eb3bf2e4c8d6359b8de5b2aea6d0d336b83cfd57255426c972e1d70 WatchSource:0}: Error finding container b0573bd48eb3bf2e4c8d6359b8de5b2aea6d0d336b83cfd57255426c972e1d70: Status 404 returned error can't find the container with id b0573bd48eb3bf2e4c8d6359b8de5b2aea6d0d336b83cfd57255426c972e1d70
Jul 16 22:01:17.925583 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.925553    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:17.925684 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.925630    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:17.925684 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:17.925664    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:18.027564 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.027534    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:18.183051 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.182981    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"]
Jul 16 22:01:18.185423 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:01:18.185399    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5366458_0eaa_461f_8e5c_1d9cd6b39e81.slice/crio-95d7c9a910afe53010c1b69a18f544df64a01a5affae5e72d80c0c528d346616 WatchSource:0}: Error finding container 95d7c9a910afe53010c1b69a18f544df64a01a5affae5e72d80c0c528d346616: Status 404 returned error can't find the container with id 95d7c9a910afe53010c1b69a18f544df64a01a5affae5e72d80c0c528d346616
Jul 16 22:01:18.188041 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.188006    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:18.188118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.188089    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:18.188158 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.188133    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:18.470885 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.470779    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr" event={"ID":"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e","Type":"ContainerStarted","Data":"a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62"}
Jul 16 22:01:18.470885 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.470843    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr" event={"ID":"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e","Type":"ContainerStarted","Data":"b0573bd48eb3bf2e4c8d6359b8de5b2aea6d0d336b83cfd57255426c972e1d70"}
Jul 16 22:01:18.472394 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.472368    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" event={"ID":"a5366458-0eaa-461f-8e5c-1d9cd6b39e81","Type":"ContainerStarted","Data":"ac34e5adf118ec6f695016f5026c2f656558f57377cb6fda2df655efe58cc0f4"}
Jul 16 22:01:18.472506 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.472416    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" event={"ID":"a5366458-0eaa-461f-8e5c-1d9cd6b39e81","Type":"ContainerStarted","Data":"95d7c9a910afe53010c1b69a18f544df64a01a5affae5e72d80c0c528d346616"}
Jul 16 22:01:18.494195 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.494142    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr" podStartSLOduration=1.494121548 podStartE2EDuration="1.494121548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:01:18.493145637 +0000 UTC m=+678.023688387" watchObservedRunningTime="2026-07-16 22:01:18.494121548 +0000 UTC m=+678.024664277"
Jul 16 22:01:18.515433 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.515376    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" podStartSLOduration=1.515361332 podStartE2EDuration="1.515361332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:01:18.513765184 +0000 UTC m=+678.044307913" watchObservedRunningTime="2026-07-16 22:01:18.515361332 +0000 UTC m=+678.045904059"
Jul 16 22:01:18.785807 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.785774    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:18.790510 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:18.790486    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:19.028156 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:19.028065    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:19.033141 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:19.033116    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:19.477315 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:19.477278    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:19.477819 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:19.477458    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:19.478400 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:19.478381    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:19.478550 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:19.478535    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:19.582042 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:19.582009    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"]
Jul 16 22:01:21.202629 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:21.202588    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:21.485655 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:21.485602    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr" podUID="5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" containerName="istio-proxy" containerID="cri-o://a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62" gracePeriod=30
Jul 16 22:01:25.205740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:25.205700    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:26.772745 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.772718    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:26.876691 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876574    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-credential-socket\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.876691 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876676    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istiod-ca-cert\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.876877 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876707    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-data\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.876877 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876755    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-podinfo\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.876877 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876778    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-envoy\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.876877 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876802    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-socket\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.876877 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876827    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjv44\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-kube-api-access-kjv44\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.876877 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876855    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-certs\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.876877 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876862    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:26.877093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876897    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-token\") pod \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\" (UID: \"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e\") "
Jul 16 22:01:26.877093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.876948    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:26.877093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.877015    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:26.877093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.877081    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:01:26.877242 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.877189    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:26.877242 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.877206    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-credential-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:26.877242 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.877221    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istiod-ca-cert\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:26.877242 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.877234    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-data\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:26.877423 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.877351    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:26.879216 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.879180    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:01:26.879376 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.879356    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:26.879444 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.879428    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:01:26.879499 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.879457    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-kube-api-access-kjv44" (OuterVolumeSpecName: "kube-api-access-kjv44") pod "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" (UID: "5e7f4889-f004-43c0-9b6f-d0674bdfbf3e"). InnerVolumeSpecName "kube-api-access-kjv44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:01:26.978084 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.978030    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-podinfo\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:26.978084 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.978077    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-envoy\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:26.978084 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.978087    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjv44\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-kube-api-access-kjv44\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:26.978084 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.978097    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-workload-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:26.978084 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:26.978106    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e-istio-token\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:27.005226 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.005189    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"]
Jul 16 22:01:27.005531 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.005519    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" containerName="istio-proxy"
Jul 16 22:01:27.005582 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.005532    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" containerName="istio-proxy"
Jul 16 22:01:27.005652 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.005584    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" containerName="istio-proxy"
Jul 16 22:01:27.008334 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.008317    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.020286 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.020258    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"]
Jul 16 22:01:27.179819 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.179730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.179819 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.179765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.179819 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.179794    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199212e2-6183-4528-a617-ecd3d0cee4a0-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.180044 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.179892    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.180044 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.179946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.180044 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.179986    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.180044 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.180027    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.180176 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.180094    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.180176 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.180121    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwtd\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-kube-api-access-dmwtd\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281343 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281310    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281549 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281351    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwtd\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-kube-api-access-dmwtd\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281549 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281549 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281549 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199212e2-6183-4528-a617-ecd3d0cee4a0-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281549 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281829 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281829 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281829 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.281938 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.281885    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.282155 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.282132    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.282309 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.282178    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.282309 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.282211    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.282448 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.282418    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199212e2-6183-4528-a617-ecd3d0cee4a0-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.283979 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.283956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.284110 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.284090    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.290817 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.290795    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.291045 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.291028    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwtd\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-kube-api-access-dmwtd\") pod \"router-gateway-1-openshift-default-799f46c59b-2gq6r\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.319061 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.319028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:27.510413 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.510348    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"]
Jul 16 22:01:27.512662 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:01:27.512612    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199212e2_6183_4528_a617_ecd3d0cee4a0.slice/crio-6c725210bdb790e3fdc193e9aaed767d8de13970857ada1b0513da76aad17481 WatchSource:0}: Error finding container 6c725210bdb790e3fdc193e9aaed767d8de13970857ada1b0513da76aad17481: Status 404 returned error can't find the container with id 6c725210bdb790e3fdc193e9aaed767d8de13970857ada1b0513da76aad17481
Jul 16 22:01:27.514438 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.514416    2569 generic.go:356] "Generic (PLEG): container finished" podID="5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" containerID="a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62" exitCode=0
Jul 16 22:01:27.514527 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.514458    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"
Jul 16 22:01:27.514527 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.514485    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr" event={"ID":"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e","Type":"ContainerDied","Data":"a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62"}
Jul 16 22:01:27.514527 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.514487    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:27.514659 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.514530    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr" event={"ID":"5e7f4889-f004-43c0-9b6f-d0674bdfbf3e","Type":"ContainerDied","Data":"b0573bd48eb3bf2e4c8d6359b8de5b2aea6d0d336b83cfd57255426c972e1d70"}
Jul 16 22:01:27.514659 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.514554    2569 scope.go:117] "RemoveContainer" containerID="a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62"
Jul 16 22:01:27.514659 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.514556    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:27.514659 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.514590    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:27.522647 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.522607    2569 scope.go:117] "RemoveContainer" containerID="a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62"
Jul 16 22:01:27.522945 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:01:27.522923    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62\": container with ID starting with a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62 not found: ID does not exist" containerID="a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62"
Jul 16 22:01:27.523021 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.522954    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62"} err="failed to get container status \"a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62\": rpc error: code = NotFound desc = could not find container \"a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62\": container with ID starting with a5257e8fe092e2ebf33a9509f00177fd8645a2c440c5747fe460200324bbcd62 not found: ID does not exist"
Jul 16 22:01:27.533008 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.532988    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"]
Jul 16 22:01:27.558653 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:27.549527    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr"]
Jul 16 22:01:28.520497 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:28.520456    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" event={"ID":"199212e2-6183-4528-a617-ecd3d0cee4a0","Type":"ContainerStarted","Data":"ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1"}
Jul 16 22:01:28.520913 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:28.520508    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" event={"ID":"199212e2-6183-4528-a617-ecd3d0cee4a0","Type":"ContainerStarted","Data":"6c725210bdb790e3fdc193e9aaed767d8de13970857ada1b0513da76aad17481"}
Jul 16 22:01:28.546646 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:28.545571    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podStartSLOduration=2.545547541 podStartE2EDuration="2.545547541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:01:28.543203528 +0000 UTC m=+688.073746245" watchObservedRunningTime="2026-07-16 22:01:28.545547541 +0000 UTC m=+688.076090271"
Jul 16 22:01:28.901639 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:28.901550    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e7f4889-f004-43c0-9b6f-d0674bdfbf3e" path="/var/lib/kubelet/pods/5e7f4889-f004-43c0-9b6f-d0674bdfbf3e/volumes"
Jul 16 22:01:29.319289 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:29.319259    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:30.336085 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:30.336025    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:01:31.337396 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:31.337339    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:01:32.338914 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:32.338859    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:01:33.340990 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:33.340293    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:01:34.341431 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:34.341341    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:01:34.960126 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:34.959737    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": read tcp 10.133.0.2:52112->10.133.0.23:15021: read: connection reset by peer"
Jul 16 22:01:35.382850 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:35.382797    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:01:35.558672 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:35.558630    2569 generic.go:356] "Generic (PLEG): container finished" podID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerID="ac34e5adf118ec6f695016f5026c2f656558f57377cb6fda2df655efe58cc0f4" exitCode=0
Jul 16 22:01:35.558856 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:35.558694    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" event={"ID":"a5366458-0eaa-461f-8e5c-1d9cd6b39e81","Type":"ContainerDied","Data":"ac34e5adf118ec6f695016f5026c2f656558f57377cb6fda2df655efe58cc0f4"}
Jul 16 22:01:35.559103 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:35.559088    2569 scope.go:117] "RemoveContainer" containerID="ac34e5adf118ec6f695016f5026c2f656558f57377cb6fda2df655efe58cc0f4"
Jul 16 22:01:35.560042 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:35.560014    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:35.560107 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:35.560097    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:35.560154 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:35.560139    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:36.424824 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:36.424775    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:01:36.567368 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:36.567337    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" event={"ID":"a5366458-0eaa-461f-8e5c-1d9cd6b39e81","Type":"ContainerStarted","Data":"86b26adfb9f850989ec8d2ca5b08ae6a5bd97d361c7ca18abdf99da0e65478ec"}
Jul 16 22:01:37.028685 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:37.028650    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:37.028953 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:37.028924    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 16 22:01:37.465859 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:37.465814    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:01:37.986056 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:37.985032    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": read tcp 10.133.0.2:56484->10.133.0.24:15021: read: connection reset by peer"
Jul 16 22:01:38.028752 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.028709    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 16 22:01:38.319586 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.319480    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 22:01:38.577716 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.577608    2569 generic.go:356] "Generic (PLEG): container finished" podID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerID="ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1" exitCode=0
Jul 16 22:01:38.577716 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.577652    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" event={"ID":"199212e2-6183-4528-a617-ecd3d0cee4a0","Type":"ContainerDied","Data":"ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1"}
Jul 16 22:01:38.578086 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.578074    2569 scope.go:117] "RemoveContainer" containerID="ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1"
Jul 16 22:01:38.579091 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.579067    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:38.579155 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.579130    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:38.579189 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.579161    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:38.774192 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:38.774150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:39.028990 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:39.028955    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 16 22:01:39.319206 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:39.319114    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:39.392277 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:39.392153    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:39.586318 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:39.586211    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" event={"ID":"199212e2-6183-4528-a617-ecd3d0cee4a0","Type":"ContainerStarted","Data":"278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4"}
Jul 16 22:01:40.028230 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:40.028176    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 16 22:01:40.320110 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:40.320019    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:40.320265 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:40.320119    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 22:01:41.028089 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:41.028052    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 16 22:01:41.319765 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:41.319660    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 22:01:42.053589 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:42.053518    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:42.162242 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:42.162198    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:42.163334 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:42.163312    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:42.171164 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:42.171083    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:42.319521 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:42.319497    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:42.319810 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:42.319785    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 22:01:43.320219 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:43.320180    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 22:01:44.320156 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:44.320119    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 22:01:45.324600 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:45.324568    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:45.325605 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:45.325586    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:01:45.405324 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:45.405286    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"]
Jul 16 22:01:45.405562 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:45.405534    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy" containerID="cri-o://86b26adfb9f850989ec8d2ca5b08ae6a5bd97d361c7ca18abdf99da0e65478ec" gracePeriod=30
Jul 16 22:01:49.634212 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:49.634127    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbda7512-284e-4616-afce-15030d362dc2" containerID="a8c8a843d65b3f2c8308f986e9d7b261596912072e0208e77c7df9bce8de39fb" exitCode=0
Jul 16 22:01:49.634212 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:49.634172    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" event={"ID":"bbda7512-284e-4616-afce-15030d362dc2","Type":"ContainerDied","Data":"a8c8a843d65b3f2c8308f986e9d7b261596912072e0208e77c7df9bce8de39fb"}
Jul 16 22:01:49.634665 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:49.634579    2569 scope.go:117] "RemoveContainer" containerID="a8c8a843d65b3f2c8308f986e9d7b261596912072e0208e77c7df9bce8de39fb"
Jul 16 22:01:49.635542 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:49.635516    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:49.635599 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:49.635578    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:49.635647 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:49.635613    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:50.661130 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.660101    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" event={"ID":"bbda7512-284e-4616-afce-15030d362dc2","Type":"ContainerStarted","Data":"e9aed949f361fcca7be151f0631bc7fd331bb6ebff421f88e08d84b45cd401fa"}
Jul 16 22:01:50.664862 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.664810    2569 generic.go:356] "Generic (PLEG): container finished" podID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerID="86b26adfb9f850989ec8d2ca5b08ae6a5bd97d361c7ca18abdf99da0e65478ec" exitCode=0
Jul 16 22:01:50.665024 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.664875    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" event={"ID":"a5366458-0eaa-461f-8e5c-1d9cd6b39e81","Type":"ContainerDied","Data":"86b26adfb9f850989ec8d2ca5b08ae6a5bd97d361c7ca18abdf99da0e65478ec"}
Jul 16 22:01:50.665024 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.664926    2569 scope.go:117] "RemoveContainer" containerID="ac34e5adf118ec6f695016f5026c2f656558f57377cb6fda2df655efe58cc0f4"
Jul 16 22:01:50.683057 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:01:50.683034    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac34e5adf118ec6f695016f5026c2f656558f57377cb6fda2df655efe58cc0f4\": container with ID starting with ac34e5adf118ec6f695016f5026c2f656558f57377cb6fda2df655efe58cc0f4 not found: ID does not exist" containerID="ac34e5adf118ec6f695016f5026c2f656558f57377cb6fda2df655efe58cc0f4"
Jul 16 22:01:50.686577 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.686552    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:50.807261 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807221    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istiod-ca-cert\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807261 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807267    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-socket\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807294    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-podinfo\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807318    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-credential-socket\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807337    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-certs\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807372    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-token\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807389    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-envoy\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807463    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-data\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807488    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7tkt\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-kube-api-access-p7tkt\") pod \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\" (UID: \"a5366458-0eaa-461f-8e5c-1d9cd6b39e81\") "
Jul 16 22:01:50.807515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807494    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:50.807999 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807684    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:50.807999 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807701    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:50.807999 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807717    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:50.807999 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807741    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:50.807999 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.807772    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:01:50.809579 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.809550    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:01:50.809711 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.809608    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-kube-api-access-p7tkt" (OuterVolumeSpecName: "kube-api-access-p7tkt") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "kube-api-access-p7tkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:01:50.809711 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.809656    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:01:50.809791 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.809729    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5366458-0eaa-461f-8e5c-1d9cd6b39e81" (UID: "a5366458-0eaa-461f-8e5c-1d9cd6b39e81"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:01:50.908220 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.908178    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-data\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:50.908220 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.908210    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7tkt\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-kube-api-access-p7tkt\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:50.908220 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.908224    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istiod-ca-cert\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:50.908487 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.908237    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-podinfo\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:50.908487 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.908250    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-credential-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:50.908487 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.908263    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-workload-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:50.908487 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.908275    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-token\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:50.908487 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:50.908287    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5366458-0eaa-461f-8e5c-1d9cd6b39e81-istio-envoy\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:01:51.126039 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:51.126006    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 22:01:51.127049 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:51.127026    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 16 22:01:51.127102 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:51.127087    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" podUID="bbda7512-284e-4616-afce-15030d362dc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 16 22:01:51.669996 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:51.669966    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"
Jul 16 22:01:51.670436 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:51.670010    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt" event={"ID":"a5366458-0eaa-461f-8e5c-1d9cd6b39e81","Type":"ContainerDied","Data":"95d7c9a910afe53010c1b69a18f544df64a01a5affae5e72d80c0c528d346616"}
Jul 16 22:01:51.670436 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:51.670063    2569 scope.go:117] "RemoveContainer" containerID="86b26adfb9f850989ec8d2ca5b08ae6a5bd97d361c7ca18abdf99da0e65478ec"
Jul 16 22:01:51.690339 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:51.690309    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"]
Jul 16 22:01:51.694888 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:51.694863    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt"]
Jul 16 22:01:52.126904 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:52.126863    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 16 22:01:52.127097 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:52.126922    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" podUID="bbda7512-284e-4616-afce-15030d362dc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 16 22:01:52.901171 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:52.901136    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" path="/var/lib/kubelet/pods/a5366458-0eaa-461f-8e5c-1d9cd6b39e81/volumes"
Jul 16 22:01:53.126774 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:53.126726    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 16 22:01:53.126990 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:53.126792    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" podUID="bbda7512-284e-4616-afce-15030d362dc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 16 22:01:53.497862 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:53.497823    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 22:01:54.126808 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:54.126773    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 16 22:01:54.127194 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:54.126829    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" podUID="bbda7512-284e-4616-afce-15030d362dc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 16 22:01:55.126583 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.126541    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body=
Jul 16 22:01:55.126783 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.126600    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw" podUID="bbda7512-284e-4616-afce-15030d362dc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused"
Jul 16 22:01:55.687048 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.687015    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"]
Jul 16 22:01:55.687500 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.687480    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy"
Jul 16 22:01:55.687548 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.687505    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy"
Jul 16 22:01:55.687605 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.687594    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy"
Jul 16 22:01:55.687659 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.687630    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy"
Jul 16 22:01:55.690751 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.690730    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.693507 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.693485    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:01:55.693708 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.693692    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 16 22:01:55.712747 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.712717    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"]
Jul 16 22:01:55.749482 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.749445    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.749663 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.749490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.749663 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.749563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf5dc\" (UniqueName: \"kubernetes.io/projected/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-kube-api-access-vf5dc\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.749663 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.749631    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.749764 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.749686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.749764 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.749749    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.821854 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.821822    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:55.851112 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851080    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.851291 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.851291 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851149    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf5dc\" (UniqueName: \"kubernetes.io/projected/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-kube-api-access-vf5dc\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.851291 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.851291 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851254    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.851512 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851313    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.851598 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851570    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.851695 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851608    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.851695 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.851649    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.853383 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.853355    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.853767 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.853746    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:55.867142 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:55.867116    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf5dc\" (UniqueName: \"kubernetes.io/projected/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-kube-api-access-vf5dc\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:56.003986 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:56.003942    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:56.130832 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:56.130055    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 22:01:56.131913 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:56.131892    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw"
Jul 16 22:01:56.132594 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:56.132574    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"]
Jul 16 22:01:56.135535 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:01:56.135509    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e955c0_b2d9_4bc4_8a70_c03c42d6cc2e.slice/crio-9d241d80978b5306d2ec17990c2aabd66982c271d1f50f7a67f25054b894df65 WatchSource:0}: Error finding container 9d241d80978b5306d2ec17990c2aabd66982c271d1f50f7a67f25054b894df65: Status 404 returned error can't find the container with id 9d241d80978b5306d2ec17990c2aabd66982c271d1f50f7a67f25054b894df65
Jul 16 22:01:56.137419 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:56.137404    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:01:56.698597 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:56.698533    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf" event={"ID":"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e","Type":"ContainerStarted","Data":"9d241d80978b5306d2ec17990c2aabd66982c271d1f50f7a67f25054b894df65"}
Jul 16 22:01:57.705201 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:57.705167    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf" event={"ID":"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e","Type":"ContainerStarted","Data":"4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100"}
Jul 16 22:01:57.807019 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:57.806950    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf" podStartSLOduration=1.750724248 podStartE2EDuration="2.806932181s" totalImagesPullingTime="1.056207933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:01:57.800812638 +0000 UTC m=+717.331355366" watchObservedRunningTime="2026-07-16 22:01:57.806932181 +0000 UTC m=+717.337474908"
Jul 16 22:01:58.004557 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.004465    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:01:58.589233 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.589201    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"]
Jul 16 22:01:58.589516 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.589504    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy"
Jul 16 22:01:58.589559 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.589517    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5366458-0eaa-461f-8e5c-1d9cd6b39e81" containerName="istio-proxy"
Jul 16 22:01:58.592281 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.592262    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.609935 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.609893    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"]
Jul 16 22:01:58.677807 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.677768    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.677985 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.677815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.677985 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.677868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.677985 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.677945    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m89sq\" (UniqueName: \"kubernetes.io/projected/948fe0ac-4b9b-4f1e-af78-566dc115309e-kube-api-access-m89sq\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.678105 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.677987    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/948fe0ac-4b9b-4f1e-af78-566dc115309e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.678105 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.678016    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.678105 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.678035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.678105 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.678062    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.678248 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.678109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.778590 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m89sq\" (UniqueName: \"kubernetes.io/projected/948fe0ac-4b9b-4f1e-af78-566dc115309e-kube-api-access-m89sq\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778601    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/948fe0ac-4b9b-4f1e-af78-566dc115309e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778712    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778744    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778772    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778827    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779118 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.778930    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779545 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.779154    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779545 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.779437    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779545 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.779501    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779706 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.779560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.779706 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.779640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/948fe0ac-4b9b-4f1e-af78-566dc115309e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.781357 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.781332    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.781587 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.781568    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.788316 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.788294    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m89sq\" (UniqueName: \"kubernetes.io/projected/948fe0ac-4b9b-4f1e-af78-566dc115309e-kube-api-access-m89sq\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.790282 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.790264    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/948fe0ac-4b9b-4f1e-af78-566dc115309e-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-gjwrm\" (UID: \"948fe0ac-4b9b-4f1e-af78-566dc115309e\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:58.902638 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:58.902552    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:01:59.033276 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:59.033236    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"]
Jul 16 22:01:59.036157 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:01:59.036132    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948fe0ac_4b9b_4f1e_af78_566dc115309e.slice/crio-5110ac18452174fa6d592735e3d1a8a56c70c00b3c26c2f5b72c45f2b0f957af WatchSource:0}: Error finding container 5110ac18452174fa6d592735e3d1a8a56c70c00b3c26c2f5b72c45f2b0f957af: Status 404 returned error can't find the container with id 5110ac18452174fa6d592735e3d1a8a56c70c00b3c26c2f5b72c45f2b0f957af
Jul 16 22:01:59.038200 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:59.038168    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:59.038261 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:59.038235    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:59.038301 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:59.038262    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:01:59.716024 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:59.715984    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" event={"ID":"948fe0ac-4b9b-4f1e-af78-566dc115309e","Type":"ContainerStarted","Data":"e84ca9ed6934505853c9e5d0e18d0bb08cb2d0619b53a5ceaa4a706a5bd1b4d4"}
Jul 16 22:01:59.716184 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:59.716040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" event={"ID":"948fe0ac-4b9b-4f1e-af78-566dc115309e","Type":"ContainerStarted","Data":"5110ac18452174fa6d592735e3d1a8a56c70c00b3c26c2f5b72c45f2b0f957af"}
Jul 16 22:01:59.739492 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:59.739442    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" podStartSLOduration=1.739426192 podStartE2EDuration="1.739426192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:01:59.738533745 +0000 UTC m=+719.269076473" watchObservedRunningTime="2026-07-16 22:01:59.739426192 +0000 UTC m=+719.269968949"
Jul 16 22:01:59.903588 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:01:59.903552    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:02:00.908284 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:00.908259    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:02:01.724942 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:01.724909    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:02:01.725776 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:01.725753    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:02:01.781557 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:01.781512    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"]
Jul 16 22:02:01.781801 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:01.781770    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy" containerID="cri-o://278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4" gracePeriod=30
Jul 16 22:02:06.004280 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:06.004236    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:02:06.016563 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:06.016541    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:02:06.757161 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:06.757122    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:02:07.037589 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.037564    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:02:07.153374 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153340    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199212e2-6183-4528-a617-ecd3d0cee4a0-istiod-ca-cert\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153581 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153385    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmwtd\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-kube-api-access-dmwtd\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153581 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153422    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-credential-socket\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153581 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153457    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-socket\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153581 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153491    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-token\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153581 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153520    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-data\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153603    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-envoy\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153690    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-podinfo\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153717    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-certs\") pod \"199212e2-6183-4528-a617-ecd3d0cee4a0\" (UID: \"199212e2-6183-4528-a617-ecd3d0cee4a0\") "
Jul 16 22:02:07.153881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153801    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:07.153881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153819    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:07.153881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153830    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:07.153881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.153853    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/199212e2-6183-4528-a617-ecd3d0cee4a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:02:07.154204 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.154005    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:07.154204 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.154077    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.154204 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.154095    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199212e2-6183-4528-a617-ecd3d0cee4a0-istiod-ca-cert\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.154204 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.154108    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-credential-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.154204 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.154122    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-workload-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.154204 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.154136    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-data\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.155749 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.155723    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-kube-api-access-dmwtd" (OuterVolumeSpecName: "kube-api-access-dmwtd") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "kube-api-access-dmwtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:02:07.155849 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.155836    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:02:07.156229 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.156204    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:02:07.156229 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.156209    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "199212e2-6183-4528-a617-ecd3d0cee4a0" (UID: "199212e2-6183-4528-a617-ecd3d0cee4a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:07.254895 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.254858    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-podinfo\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.254895 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.254890    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmwtd\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-kube-api-access-dmwtd\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.254895 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.254901    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-token\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.255135 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.254910    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199212e2-6183-4528-a617-ecd3d0cee4a0-istio-envoy\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:07.758328 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.758286    2569 generic.go:356] "Generic (PLEG): container finished" podID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerID="278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4" exitCode=0
Jul 16 22:02:07.758328 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.758322    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" event={"ID":"199212e2-6183-4528-a617-ecd3d0cee4a0","Type":"ContainerDied","Data":"278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4"}
Jul 16 22:02:07.758594 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.758362    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"
Jul 16 22:02:07.758594 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.758419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r" event={"ID":"199212e2-6183-4528-a617-ecd3d0cee4a0","Type":"ContainerDied","Data":"6c725210bdb790e3fdc193e9aaed767d8de13970857ada1b0513da76aad17481"}
Jul 16 22:02:07.758594 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.758446    2569 scope.go:117] "RemoveContainer" containerID="278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4"
Jul 16 22:02:07.767131 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.767110    2569 scope.go:117] "RemoveContainer" containerID="ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1"
Jul 16 22:02:07.774740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.774677    2569 scope.go:117] "RemoveContainer" containerID="278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4"
Jul 16 22:02:07.775005 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:02:07.774986    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4\": container with ID starting with 278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4 not found: ID does not exist" containerID="278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4"
Jul 16 22:02:07.775052 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.775014    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4"} err="failed to get container status \"278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4\": rpc error: code = NotFound desc = could not find container \"278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4\": container with ID starting with 278dec73360e347a2739a743db1af551e14fa1f6ec35e6bc53f9e292ebadbfd4 not found: ID does not exist"
Jul 16 22:02:07.775052 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.775033    2569 scope.go:117] "RemoveContainer" containerID="ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1"
Jul 16 22:02:07.775306 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:02:07.775289    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1\": container with ID starting with ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1 not found: ID does not exist" containerID="ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1"
Jul 16 22:02:07.775362 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.775311    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1"} err="failed to get container status \"ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1\": rpc error: code = NotFound desc = could not find container \"ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1\": container with ID starting with ba78b47df57b52434f44ca43dcea0614c014d1fb1b6b597c3ccf27e40e8b83a1 not found: ID does not exist"
Jul 16 22:02:07.786455 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.786424    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"]
Jul 16 22:02:07.789386 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:07.789366    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r"]
Jul 16 22:02:08.901245 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:08.901211    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" path="/var/lib/kubelet/pods/199212e2-6183-4528-a617-ecd3d0cee4a0/volumes"
Jul 16 22:02:17.672812 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:17.672778    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:02:17.776138 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:17.776099    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"]
Jul 16 22:02:17.800033 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:17.800001    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:02:28.615100 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:28.615066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:02:29.045144 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:29.045104    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:02:32.795910 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:32.795839    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf" podUID="a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" containerName="main" containerID="cri-o://4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100" gracePeriod=45
Jul 16 22:02:33.053785 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.053698    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:02:33.087630 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.087584    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-model-cache\") pod \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") "
Jul 16 22:02:33.087801 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.087673    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-home\") pod \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") "
Jul 16 22:02:33.087801 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.087727    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-dshm\") pod \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") "
Jul 16 22:02:33.087801 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.087757    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tls-certs\") pod \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") "
Jul 16 22:02:33.087801 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.087789    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf5dc\" (UniqueName: \"kubernetes.io/projected/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-kube-api-access-vf5dc\") pod \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") "
Jul 16 22:02:33.088020 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.087817    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tmp-dir\") pod \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\" (UID: \"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e\") "
Jul 16 22:02:33.088020 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.087864    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" (UID: "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:33.088020 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.087940    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-home" (OuterVolumeSpecName: "home") pod "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" (UID: "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:33.088176 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.088121    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:33.088176 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.088139    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:33.088279 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.088191    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" (UID: "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:33.089918 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.089885    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" (UID: "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:02:33.090299 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.090278    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-dshm" (OuterVolumeSpecName: "dshm") pod "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" (UID: "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:02:33.090404 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.090386    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-kube-api-access-vf5dc" (OuterVolumeSpecName: "kube-api-access-vf5dc") pod "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" (UID: "a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e"). InnerVolumeSpecName "kube-api-access-vf5dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:02:33.188908 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.188871    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:33.188908 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.188901    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:33.188908 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.188912    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf5dc\" (UniqueName: \"kubernetes.io/projected/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-kube-api-access-vf5dc\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:33.188908 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.188920    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:02:33.878913 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.878877    2569 generic.go:356] "Generic (PLEG): container finished" podID="a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" containerID="4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100" exitCode=0
Jul 16 22:02:33.879325 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.878952    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"
Jul 16 22:02:33.879325 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.878956    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf" event={"ID":"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e","Type":"ContainerDied","Data":"4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100"}
Jul 16 22:02:33.879325 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.879032    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf" event={"ID":"a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e","Type":"ContainerDied","Data":"9d241d80978b5306d2ec17990c2aabd66982c271d1f50f7a67f25054b894df65"}
Jul 16 22:02:33.879325 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.879055    2569 scope.go:117] "RemoveContainer" containerID="4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100"
Jul 16 22:02:33.888448 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.888430    2569 scope.go:117] "RemoveContainer" containerID="4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100"
Jul 16 22:02:33.888828 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:02:33.888806    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100\": container with ID starting with 4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100 not found: ID does not exist" containerID="4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100"
Jul 16 22:02:33.888881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.888839    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100"} err="failed to get container status \"4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100\": rpc error: code = NotFound desc = could not find container \"4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100\": container with ID starting with 4db171c61079bafca59724c2ad0f0accc0135605d64c985cc1eaecdec889a100 not found: ID does not exist"
Jul 16 22:02:33.903901 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.903869    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"]
Jul 16 22:02:33.907289 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:33.907260    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf"]
Jul 16 22:02:34.900631 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:34.900586    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" path="/var/lib/kubelet/pods/a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e/volumes"
Jul 16 22:02:37.963111 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:02:37.963080    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:03:12.870158 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:03:12.870123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:03:12.968665 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:03:12.968610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:03:27.797043 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:03:27.796943    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:03:27.860277 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:03:27.860249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:09.388096 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.388054    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"]
Jul 16 22:04:09.388547 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.388533    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy"
Jul 16 22:04:09.388590 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.388551    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy"
Jul 16 22:04:09.388590 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.388568    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" containerName="main"
Jul 16 22:04:09.388590 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.388577    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" containerName="main"
Jul 16 22:04:09.388703 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.388691    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e955c0-b2d9-4bc4-8a70-c03c42d6cc2e" containerName="main"
Jul 16 22:04:09.388740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.388702    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy"
Jul 16 22:04:09.388740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.388712    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy"
Jul 16 22:04:09.391909 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.391874    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.396040 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.396016    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:04:09.396040 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.396027    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jul 16 22:04:09.401701 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.401676    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"]
Jul 16 22:04:09.417858 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.417822    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.417858 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.417860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.418135 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.417889    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.418135 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.418029    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dxvp\" (UniqueName: \"kubernetes.io/projected/cf2483e1-88d7-4f44-a7f6-52a990da5649-kube-api-access-4dxvp\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.418135 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.418066    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2483e1-88d7-4f44-a7f6-52a990da5649-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.418135 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.418107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.423743 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.423713    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:09.518843 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.518804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.518843 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.518846    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.519107 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.518876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.519107 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.518932    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dxvp\" (UniqueName: \"kubernetes.io/projected/cf2483e1-88d7-4f44-a7f6-52a990da5649-kube-api-access-4dxvp\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.519107 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.518954    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2483e1-88d7-4f44-a7f6-52a990da5649-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.519107 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.518971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.519380 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.519346    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.519507 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.519393    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.519507 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.519419    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.521228 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.521207    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.521400 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.521383    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2483e1-88d7-4f44-a7f6-52a990da5649-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.529530 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.529503    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dxvp\" (UniqueName: \"kubernetes.io/projected/cf2483e1-88d7-4f44-a7f6-52a990da5649-kube-api-access-4dxvp\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.674736 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.674651    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:09.703790 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.703751    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:09.844024 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:09.843989    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"]
Jul 16 22:04:09.847057 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:04:09.847033    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2483e1_88d7_4f44_a7f6_52a990da5649.slice/crio-f830aa79662d9b942d8dc0ca4465c83a3c14f98bfd0fbb4463f856ab23ac54ca WatchSource:0}: Error finding container f830aa79662d9b942d8dc0ca4465c83a3c14f98bfd0fbb4463f856ab23ac54ca: Status 404 returned error can't find the container with id f830aa79662d9b942d8dc0ca4465c83a3c14f98bfd0fbb4463f856ab23ac54ca
Jul 16 22:04:10.272868 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:10.272830    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2" event={"ID":"cf2483e1-88d7-4f44-a7f6-52a990da5649","Type":"ContainerStarted","Data":"e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac"}
Jul 16 22:04:10.273054 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:10.272884    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2" event={"ID":"cf2483e1-88d7-4f44-a7f6-52a990da5649","Type":"ContainerStarted","Data":"f830aa79662d9b942d8dc0ca4465c83a3c14f98bfd0fbb4463f856ab23ac54ca"}
Jul 16 22:04:10.290949 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:10.290898    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2" podStartSLOduration=1.290882951 podStartE2EDuration="1.290882951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:04:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:04:10.289901065 +0000 UTC m=+849.820443791" watchObservedRunningTime="2026-07-16 22:04:10.290882951 +0000 UTC m=+849.821425677"
Jul 16 22:04:10.704833 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:10.704806    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:14.212452 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:14.212416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:19.704859 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:19.704814    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:19.717310 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:19.717284    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:20.327827 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:20.327795    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:42.347250 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:42.347208    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:42.350196 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:42.350169    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"]
Jul 16 22:04:42.442773 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:42.442735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:45.033522 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:45.033487    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:45.102500 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:45.102464    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:53.830082 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:53.830044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:53.898829 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:53.898790    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:57.370538 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.370488    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2" podUID="cf2483e1-88d7-4f44-a7f6-52a990da5649" containerName="main" containerID="cri-o://e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac" gracePeriod=45
Jul 16 22:04:57.624745 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.624686    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:57.737455 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737415    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-tmp-dir\") pod \"cf2483e1-88d7-4f44-a7f6-52a990da5649\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") "
Jul 16 22:04:57.737678 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737466    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dxvp\" (UniqueName: \"kubernetes.io/projected/cf2483e1-88d7-4f44-a7f6-52a990da5649-kube-api-access-4dxvp\") pod \"cf2483e1-88d7-4f44-a7f6-52a990da5649\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") "
Jul 16 22:04:57.737678 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737500    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-dshm\") pod \"cf2483e1-88d7-4f44-a7f6-52a990da5649\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") "
Jul 16 22:04:57.737678 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737538    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-model-cache\") pod \"cf2483e1-88d7-4f44-a7f6-52a990da5649\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") "
Jul 16 22:04:57.737678 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737564    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2483e1-88d7-4f44-a7f6-52a990da5649-tls-certs\") pod \"cf2483e1-88d7-4f44-a7f6-52a990da5649\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") "
Jul 16 22:04:57.737678 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737584    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-home\") pod \"cf2483e1-88d7-4f44-a7f6-52a990da5649\" (UID: \"cf2483e1-88d7-4f44-a7f6-52a990da5649\") "
Jul 16 22:04:57.737950 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737756    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cf2483e1-88d7-4f44-a7f6-52a990da5649" (UID: "cf2483e1-88d7-4f44-a7f6-52a990da5649"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:04:57.737950 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737850    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-model-cache" (OuterVolumeSpecName: "model-cache") pod "cf2483e1-88d7-4f44-a7f6-52a990da5649" (UID: "cf2483e1-88d7-4f44-a7f6-52a990da5649"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:04:57.737950 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737927    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-home" (OuterVolumeSpecName: "home") pod "cf2483e1-88d7-4f44-a7f6-52a990da5649" (UID: "cf2483e1-88d7-4f44-a7f6-52a990da5649"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:04:57.738069 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737960    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:04:57.738069 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.737986    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:04:57.739763 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.739743    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-dshm" (OuterVolumeSpecName: "dshm") pod "cf2483e1-88d7-4f44-a7f6-52a990da5649" (UID: "cf2483e1-88d7-4f44-a7f6-52a990da5649"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:04:57.739834 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.739783    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf2483e1-88d7-4f44-a7f6-52a990da5649-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf2483e1-88d7-4f44-a7f6-52a990da5649" (UID: "cf2483e1-88d7-4f44-a7f6-52a990da5649"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:04:57.739887 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.739872    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf2483e1-88d7-4f44-a7f6-52a990da5649-kube-api-access-4dxvp" (OuterVolumeSpecName: "kube-api-access-4dxvp") pod "cf2483e1-88d7-4f44-a7f6-52a990da5649" (UID: "cf2483e1-88d7-4f44-a7f6-52a990da5649"). InnerVolumeSpecName "kube-api-access-4dxvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:04:57.839285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.839230    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dxvp\" (UniqueName: \"kubernetes.io/projected/cf2483e1-88d7-4f44-a7f6-52a990da5649-kube-api-access-4dxvp\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:04:57.839285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.839273    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:04:57.839285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.839292    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2483e1-88d7-4f44-a7f6-52a990da5649-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:04:57.839285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:57.839301    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf2483e1-88d7-4f44-a7f6-52a990da5649-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:04:58.481381 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.481347    2569 generic.go:356] "Generic (PLEG): container finished" podID="cf2483e1-88d7-4f44-a7f6-52a990da5649" containerID="e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac" exitCode=0
Jul 16 22:04:58.481882 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.481391    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"
Jul 16 22:04:58.481882 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.481414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2" event={"ID":"cf2483e1-88d7-4f44-a7f6-52a990da5649","Type":"ContainerDied","Data":"e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac"}
Jul 16 22:04:58.481882 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.481469    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2" event={"ID":"cf2483e1-88d7-4f44-a7f6-52a990da5649","Type":"ContainerDied","Data":"f830aa79662d9b942d8dc0ca4465c83a3c14f98bfd0fbb4463f856ab23ac54ca"}
Jul 16 22:04:58.481882 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.481494    2569 scope.go:117] "RemoveContainer" containerID="e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac"
Jul 16 22:04:58.493376 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.493354    2569 scope.go:117] "RemoveContainer" containerID="e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac"
Jul 16 22:04:58.493682 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:04:58.493663    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac\": container with ID starting with e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac not found: ID does not exist" containerID="e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac"
Jul 16 22:04:58.493724 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.493692    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac"} err="failed to get container status \"e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac\": rpc error: code = NotFound desc = could not find container \"e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac\": container with ID starting with e9eb4fe9467c9f52398f0ea9510cd59b68b632299adede83c7f8b71b2961e4ac not found: ID does not exist"
Jul 16 22:04:58.514990 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.514957    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"]
Jul 16 22:04:58.521121 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.521091    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2"]
Jul 16 22:04:58.901010 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:04:58.900933    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf2483e1-88d7-4f44-a7f6-52a990da5649" path="/var/lib/kubelet/pods/cf2483e1-88d7-4f44-a7f6-52a990da5649/volumes"
Jul 16 22:05:09.335081 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:09.335048    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:09.996048 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:09.996007    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:13.269960 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:13.269924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:16.728120 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:16.728087    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:16.970751 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:16.970718    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:25.371574 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:25.371528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:33.687255 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:33.687216    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:57.411695 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.411653    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"]
Jul 16 22:05:57.412298 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.412106    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf2483e1-88d7-4f44-a7f6-52a990da5649" containerName="main"
Jul 16 22:05:57.412298 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.412123    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf2483e1-88d7-4f44-a7f6-52a990da5649" containerName="main"
Jul 16 22:05:57.412298 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.412144    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy"
Jul 16 22:05:57.412298 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.412154    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="199212e2-6183-4528-a617-ecd3d0cee4a0" containerName="istio-proxy"
Jul 16 22:05:57.412298 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.412237    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf2483e1-88d7-4f44-a7f6-52a990da5649" containerName="main"
Jul 16 22:05:57.414712 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.414691    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.420059 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.420037    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:05:57.420248 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.420222    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Jul 16 22:05:57.428340 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.428315    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"]
Jul 16 22:05:57.460428 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.460390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk82h\" (UniqueName: \"kubernetes.io/projected/fa5a53be-d410-49bb-b69b-9bd566aff5ea-kube-api-access-qk82h\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.460644 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.460447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.460644 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.460474    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.460644 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.460496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.460644 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.460527    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.460644 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.460565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.561460 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.561419    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.561460 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.561461    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.561731 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.561485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.561731 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.561519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.561731 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.561555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.561731 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.561693    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk82h\" (UniqueName: \"kubernetes.io/projected/fa5a53be-d410-49bb-b69b-9bd566aff5ea-kube-api-access-qk82h\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.561936 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.561880    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.561994 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.561944    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.562056 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.562034    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.563855 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.563833    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.564005 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.563987    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.570591 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.570565    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk82h\" (UniqueName: \"kubernetes.io/projected/fa5a53be-d410-49bb-b69b-9bd566aff5ea-kube-api-access-qk82h\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.725127 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.725074    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:57.863416 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:57.863380    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"]
Jul 16 22:05:57.866091 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:05:57.866059    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5a53be_d410_49bb_b69b_9bd566aff5ea.slice/crio-633c36253cede242a8728def2f84dc409c362c56568957104f7a5ae7bddf6136 WatchSource:0}: Error finding container 633c36253cede242a8728def2f84dc409c362c56568957104f7a5ae7bddf6136: Status 404 returned error can't find the container with id 633c36253cede242a8728def2f84dc409c362c56568957104f7a5ae7bddf6136
Jul 16 22:05:58.059362 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:58.059276    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:58.135989 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:58.135929    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:58.717386 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:58.717348    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng" event={"ID":"fa5a53be-d410-49bb-b69b-9bd566aff5ea","Type":"ContainerStarted","Data":"3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c"}
Jul 16 22:05:58.717819 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:58.717416    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng" event={"ID":"fa5a53be-d410-49bb-b69b-9bd566aff5ea","Type":"ContainerStarted","Data":"633c36253cede242a8728def2f84dc409c362c56568957104f7a5ae7bddf6136"}
Jul 16 22:05:58.725922 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:58.725902    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:05:58.740570 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:05:58.740522    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng" podStartSLOduration=1.740504108 podStartE2EDuration="1.740504108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:05:58.738061785 +0000 UTC m=+958.268604513" watchObservedRunningTime="2026-07-16 22:05:58.740504108 +0000 UTC m=+958.271046836"
Jul 16 22:06:07.725570 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:07.725528    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:06:07.738195 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:07.738169    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:06:07.769219 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:07.769190    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:06:13.132025 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:13.131990    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:30.916066 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:30.916028    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"]
Jul 16 22:06:30.995299 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:30.995242    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:31.097284 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:31.097255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:45.937123 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:45.937073    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng" podUID="fa5a53be-d410-49bb-b69b-9bd566aff5ea" containerName="main" containerID="cri-o://3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c" gracePeriod=45
Jul 16 22:06:46.190961 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.190894    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:06:46.296515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296484    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk82h\" (UniqueName: \"kubernetes.io/projected/fa5a53be-d410-49bb-b69b-9bd566aff5ea-kube-api-access-qk82h\") pod \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") "
Jul 16 22:06:46.296720 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296530    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tmp-dir\") pod \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") "
Jul 16 22:06:46.296720 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296572    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-dshm\") pod \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") "
Jul 16 22:06:46.296720 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296596    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-home\") pod \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") "
Jul 16 22:06:46.296720 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296614    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-model-cache\") pod \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") "
Jul 16 22:06:46.296720 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296693    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tls-certs\") pod \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\" (UID: \"fa5a53be-d410-49bb-b69b-9bd566aff5ea\") "
Jul 16 22:06:46.296984 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296876    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fa5a53be-d410-49bb-b69b-9bd566aff5ea" (UID: "fa5a53be-d410-49bb-b69b-9bd566aff5ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:06:46.296984 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296893    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-home" (OuterVolumeSpecName: "home") pod "fa5a53be-d410-49bb-b69b-9bd566aff5ea" (UID: "fa5a53be-d410-49bb-b69b-9bd566aff5ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:06:46.297075 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.296991    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "fa5a53be-d410-49bb-b69b-9bd566aff5ea" (UID: "fa5a53be-d410-49bb-b69b-9bd566aff5ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:06:46.297075 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.297054    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:06:46.297144 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.297074    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:06:46.297144 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.297093    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:06:46.298837 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.298813    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-dshm" (OuterVolumeSpecName: "dshm") pod "fa5a53be-d410-49bb-b69b-9bd566aff5ea" (UID: "fa5a53be-d410-49bb-b69b-9bd566aff5ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:06:46.298900 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.298821    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fa5a53be-d410-49bb-b69b-9bd566aff5ea" (UID: "fa5a53be-d410-49bb-b69b-9bd566aff5ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:06:46.298900 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.298822    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5a53be-d410-49bb-b69b-9bd566aff5ea-kube-api-access-qk82h" (OuterVolumeSpecName: "kube-api-access-qk82h") pod "fa5a53be-d410-49bb-b69b-9bd566aff5ea" (UID: "fa5a53be-d410-49bb-b69b-9bd566aff5ea"). InnerVolumeSpecName "kube-api-access-qk82h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:06:46.398002 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.397955    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5a53be-d410-49bb-b69b-9bd566aff5ea-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:06:46.398002 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.397996    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk82h\" (UniqueName: \"kubernetes.io/projected/fa5a53be-d410-49bb-b69b-9bd566aff5ea-kube-api-access-qk82h\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:06:46.398002 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.398008    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa5a53be-d410-49bb-b69b-9bd566aff5ea-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:06:46.925568 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.925531    2569 generic.go:356] "Generic (PLEG): container finished" podID="fa5a53be-d410-49bb-b69b-9bd566aff5ea" containerID="3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c" exitCode=0
Jul 16 22:06:46.925760 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.925583    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"
Jul 16 22:06:46.925760 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.925577    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng" event={"ID":"fa5a53be-d410-49bb-b69b-9bd566aff5ea","Type":"ContainerDied","Data":"3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c"}
Jul 16 22:06:46.925760 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.925671    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng" event={"ID":"fa5a53be-d410-49bb-b69b-9bd566aff5ea","Type":"ContainerDied","Data":"633c36253cede242a8728def2f84dc409c362c56568957104f7a5ae7bddf6136"}
Jul 16 22:06:46.925760 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.925693    2569 scope.go:117] "RemoveContainer" containerID="3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c"
Jul 16 22:06:46.934104 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.934085    2569 scope.go:117] "RemoveContainer" containerID="3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c"
Jul 16 22:06:46.934418 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:06:46.934399    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c\": container with ID starting with 3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c not found: ID does not exist" containerID="3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c"
Jul 16 22:06:46.934515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.934425    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c"} err="failed to get container status \"3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c\": rpc error: code = NotFound desc = could not find container \"3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c\": container with ID starting with 3dfc0c6ebfdbd6ad4538367a2d6f0073b9af85a92774fe77e5831fc4557f673c not found: ID does not exist"
Jul 16 22:06:46.947690 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.947655    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"]
Jul 16 22:06:46.951399 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:46.951372    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng"]
Jul 16 22:06:48.901174 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:48.901143    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa5a53be-d410-49bb-b69b-9bd566aff5ea" path="/var/lib/kubelet/pods/fa5a53be-d410-49bb-b69b-9bd566aff5ea/volumes"
Jul 16 22:06:51.323294 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:51.323235    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:51.411971 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:51.411938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:59.875502 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:06:59.875466    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:17.945662 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:07:17.945606    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:21.637403 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:07:21.637368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:21.946276 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:07:21.946198    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:55.085245 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:07:55.085114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:56.715884 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:07:56.715848    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:56.787654 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:07:56.787600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:08:06.708550 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.708514    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"]
Jul 16 22:08:06.709023 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.708904    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5a53be-d410-49bb-b69b-9bd566aff5ea" containerName="main"
Jul 16 22:08:06.709023 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.708919    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5a53be-d410-49bb-b69b-9bd566aff5ea" containerName="main"
Jul 16 22:08:06.709023 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.708989    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa5a53be-d410-49bb-b69b-9bd566aff5ea" containerName="main"
Jul 16 22:08:06.711879 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.711864    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.715747 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.715705    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:08:06.715887 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.715763    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Jul 16 22:08:06.726382 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.726356    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"]
Jul 16 22:08:06.739235 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.739181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:08:06.800928 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.800896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.801133 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.800970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.801133 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.801024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.801133 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.801046    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrfj\" (UniqueName: \"kubernetes.io/projected/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-kube-api-access-brrfj\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.801133 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.801086    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.801288 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.801161    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.902494 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.902467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.902494 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.902497    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfj\" (UniqueName: \"kubernetes.io/projected/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-kube-api-access-brrfj\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.902761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.902524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.902761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.902545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.902761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.902581    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.902761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.902648    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.902940 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.902896    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.902991 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.902970    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.903072 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.903054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.904894 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.904867    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.905133 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.905117    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:06.918378 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:06.918343    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrfj\" (UniqueName: \"kubernetes.io/projected/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-kube-api-access-brrfj\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:07.005925 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:07.005831    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:08:07.021496 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:07.021456    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:07.166566 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:07.166529    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"]
Jul 16 22:08:07.169470 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:08:07.169443    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5521ad_dee4_4bbc_8d60_d95ac3e9acd4.slice/crio-239ec3764844e3de6a4ab78beb2146cc6f515deb2248f0e631c60e0deb295d12 WatchSource:0}: Error finding container 239ec3764844e3de6a4ab78beb2146cc6f515deb2248f0e631c60e0deb295d12: Status 404 returned error can't find the container with id 239ec3764844e3de6a4ab78beb2146cc6f515deb2248f0e631c60e0deb295d12
Jul 16 22:08:07.242315 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:07.242283    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn" event={"ID":"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4","Type":"ContainerStarted","Data":"7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e"}
Jul 16 22:08:07.242528 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:07.242332    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn" event={"ID":"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4","Type":"ContainerStarted","Data":"239ec3764844e3de6a4ab78beb2146cc6f515deb2248f0e631c60e0deb295d12"}
Jul 16 22:08:07.263107 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:07.263002    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn" podStartSLOduration=1.262982888 podStartE2EDuration="1.262982888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:08:07.262094239 +0000 UTC m=+1086.792636967" watchObservedRunningTime="2026-07-16 22:08:07.262982888 +0000 UTC m=+1086.793525615"
Jul 16 22:08:08.022261 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:08.022225    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:17.021814 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:17.021771    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:17.034550 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:17.034522    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:17.296979 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:17.296880    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:08:26.846935 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:26.846880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:08:49.243302 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:49.243267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:08:49.662910 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:08:49.662809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:09:03.415678 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:03.415635    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:09:03.526185 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:03.526147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:09:12.798711 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:12.798666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:09:15.016321 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:15.016282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:09:15.032901 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:15.032866    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"]
Jul 16 22:09:15.090796 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:15.090758    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:09:30.052871 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.052756    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn" podUID="3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" containerName="main" containerID="cri-o://7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e" gracePeriod=45
Jul 16 22:09:30.313925 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.313860    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:09:30.456008 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.455971    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-model-cache\") pod \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") "
Jul 16 22:09:30.456189 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456026    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tls-certs\") pod \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") "
Jul 16 22:09:30.456189 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456057    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tmp-dir\") pod \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") "
Jul 16 22:09:30.456189 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456086    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brrfj\" (UniqueName: \"kubernetes.io/projected/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-kube-api-access-brrfj\") pod \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") "
Jul 16 22:09:30.456189 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456126    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-dshm\") pod \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") "
Jul 16 22:09:30.456189 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456173    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-home\") pod \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\" (UID: \"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4\") "
Jul 16 22:09:30.456449 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456272    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" (UID: "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:30.456449 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456401    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" (UID: "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:30.456561 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456473    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-home" (OuterVolumeSpecName: "home") pod "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" (UID: "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:30.456599 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456564    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:09:30.456599 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456583    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:09:30.456599 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.456591    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:09:30.458267 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.458243    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-dshm" (OuterVolumeSpecName: "dshm") pod "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" (UID: "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:30.458664 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.458635    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" (UID: "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:09:30.458761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.458664    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-kube-api-access-brrfj" (OuterVolumeSpecName: "kube-api-access-brrfj") pod "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" (UID: "3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4"). InnerVolumeSpecName "kube-api-access-brrfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:09:30.557753 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.557719    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:09:30.557753 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.557746    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:09:30.557753 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.557757    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brrfj\" (UniqueName: \"kubernetes.io/projected/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4-kube-api-access-brrfj\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:09:30.606061 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.605973    2569 generic.go:356] "Generic (PLEG): container finished" podID="3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" containerID="7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e" exitCode=0
Jul 16 22:09:30.606061 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.606021    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"
Jul 16 22:09:30.606248 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.606060    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn" event={"ID":"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4","Type":"ContainerDied","Data":"7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e"}
Jul 16 22:09:30.606248 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.606115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn" event={"ID":"3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4","Type":"ContainerDied","Data":"239ec3764844e3de6a4ab78beb2146cc6f515deb2248f0e631c60e0deb295d12"}
Jul 16 22:09:30.606248 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.606144    2569 scope.go:117] "RemoveContainer" containerID="7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e"
Jul 16 22:09:30.615390 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.615367    2569 scope.go:117] "RemoveContainer" containerID="7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e"
Jul 16 22:09:30.615683 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:09:30.615666    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e\": container with ID starting with 7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e not found: ID does not exist" containerID="7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e"
Jul 16 22:09:30.615741 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.615693    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e"} err="failed to get container status \"7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e\": rpc error: code = NotFound desc = could not find container \"7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e\": container with ID starting with 7a5b1e08718eb34c336b12f3ac73cc4fbbcc814f1205203f256b570ffb2cd86e not found: ID does not exist"
Jul 16 22:09:30.627574 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.627544    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"]
Jul 16 22:09:30.633721 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.633696    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn"]
Jul 16 22:09:30.901170 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:30.901096    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" path="/var/lib/kubelet/pods/3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4/volumes"
Jul 16 22:09:31.287086 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:31.287042    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn" podUID="3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:09:34.943123 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:34.943072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:09:35.010760 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:09:35.010714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:10:02.250431 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:10:02.250394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:10:02.542425 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:10:02.542327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:10:15.879359 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:10:15.879313    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:10:54.321788 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:10:54.321708    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:10:55.869664 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:10:55.869601    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:11:15.121449 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.121409    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"]
Jul 16 22:11:15.121880 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.121744    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" containerName="main"
Jul 16 22:11:15.121880 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.121756    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" containerName="main"
Jul 16 22:11:15.121880 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.121808    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f5521ad-dee4-4bbc-8d60-d95ac3e9acd4" containerName="main"
Jul 16 22:11:15.124936 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.124906    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.162552 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.162503    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"]
Jul 16 22:11:15.189088 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189058    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.189292 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg7rt\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-kube-api-access-gg7rt\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.189292 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189166    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.189292 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.189292 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189232    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.189292 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189282    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cbb48f6-792c-4519-892f-f696b8df2337-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.189561 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cbb48f6-792c-4519-892f-f696b8df2337-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.189561 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189364    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.189561 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.189404    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.289866 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.289831    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cbb48f6-792c-4519-892f-f696b8df2337-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.289866 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.289871    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cbb48f6-792c-4519-892f-f696b8df2337-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290113 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.289899    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290113 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.289914    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290113 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290270 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg7rt\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-kube-api-access-gg7rt\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290270 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290270 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290270 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290492 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290453    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290569 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290544    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290654 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290596    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cbb48f6-792c-4519-892f-f696b8df2337-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290654 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290607    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.290769 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.290663    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.292278 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.292255    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.292529 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.292510    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cbb48f6-792c-4519-892f-f696b8df2337-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.305438 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.305413    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg7rt\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-kube-api-access-gg7rt\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.306886 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.306862    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-nbkkb\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.437304 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.437204    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:15.585054 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.584875    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"]
Jul 16 22:11:15.587762 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:11:15.587729    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbb48f6_792c_4519_892f_f696b8df2337.slice/crio-8f28f61749175ff9463ef8f9710eb6e2748be74d398c031922b5eb435c17cf23 WatchSource:0}: Error finding container 8f28f61749175ff9463ef8f9710eb6e2748be74d398c031922b5eb435c17cf23: Status 404 returned error can't find the container with id 8f28f61749175ff9463ef8f9710eb6e2748be74d398c031922b5eb435c17cf23
Jul 16 22:11:15.589902 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.589871    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:11:15.589991 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.589936    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:11:15.589991 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.589966    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:11:15.801752 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:15.801716    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"]
Jul 16 22:11:16.053052 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:16.052961    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb" event={"ID":"3cbb48f6-792c-4519-892f-f696b8df2337","Type":"ContainerStarted","Data":"688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a"}
Jul 16 22:11:16.053052 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:16.053013    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb" event={"ID":"3cbb48f6-792c-4519-892f-f696b8df2337","Type":"ContainerStarted","Data":"8f28f61749175ff9463ef8f9710eb6e2748be74d398c031922b5eb435c17cf23"}
Jul 16 22:11:16.082496 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:16.082438    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb" podStartSLOduration=1.082420221 podStartE2EDuration="1.082420221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:11:16.081212174 +0000 UTC m=+1275.611754902" watchObservedRunningTime="2026-07-16 22:11:16.082420221 +0000 UTC m=+1275.612962948"
Jul 16 22:11:16.438101 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:16.438002    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:16.443222 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:16.443192    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:17.057425 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:17.057382    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb" podUID="3cbb48f6-792c-4519-892f-f696b8df2337" containerName="istio-proxy" containerID="cri-o://688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a" gracePeriod=30
Jul 16 22:11:17.057643 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:17.057500    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:17.058465 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:17.058446    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:20.678519 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.678470    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"]
Jul 16 22:11:20.683175 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.683138    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.687480 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.687457    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:11:20.688477 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.688460    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs\""
Jul 16 22:11:20.767775 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.767735    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"]
Jul 16 22:11:20.771840 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.771807    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:11:20.837660 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.837608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.837882 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.837756    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.837882 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.837828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a1de4e-7194-466b-8315-de5791efd462-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.837969 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.837876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2db\" (UniqueName: \"kubernetes.io/projected/62a1de4e-7194-466b-8315-de5791efd462-kube-api-access-tm2db\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.838014 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.837962    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.838060 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.838018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.939401 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.939294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a1de4e-7194-466b-8315-de5791efd462-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.939401 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.939333    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2db\" (UniqueName: \"kubernetes.io/projected/62a1de4e-7194-466b-8315-de5791efd462-kube-api-access-tm2db\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.939401 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.939352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.939401 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.939379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.939776 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.939418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.939776 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.939462    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.945534 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.939837    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.945534 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.940163    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.945534 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.940241    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.947705 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.947674    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a1de4e-7194-466b-8315-de5791efd462-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.948490 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.948467    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2db\" (UniqueName: \"kubernetes.io/projected/62a1de4e-7194-466b-8315-de5791efd462-kube-api-access-tm2db\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.948611 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.948560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:20.993862 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:20.993817    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:21.130304 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:21.130279    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"]
Jul 16 22:11:21.132766 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:11:21.132738    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a1de4e_7194_466b_8315_de5791efd462.slice/crio-b2b0caff9633540c95fee390a6b1412486700f20accfa18d1e4caa356a7a0e91 WatchSource:0}: Error finding container b2b0caff9633540c95fee390a6b1412486700f20accfa18d1e4caa356a7a0e91: Status 404 returned error can't find the container with id b2b0caff9633540c95fee390a6b1412486700f20accfa18d1e4caa356a7a0e91
Jul 16 22:11:22.081827 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.081783    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph" event={"ID":"62a1de4e-7194-466b-8315-de5791efd462","Type":"ContainerStarted","Data":"690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d"}
Jul 16 22:11:22.082242 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.081850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph" event={"ID":"62a1de4e-7194-466b-8315-de5791efd462","Type":"ContainerStarted","Data":"b2b0caff9633540c95fee390a6b1412486700f20accfa18d1e4caa356a7a0e91"}
Jul 16 22:11:22.100808 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.100757    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph" podStartSLOduration=2.100742057 podStartE2EDuration="2.100742057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:11:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:11:22.099611642 +0000 UTC m=+1281.630154381" watchObservedRunningTime="2026-07-16 22:11:22.100742057 +0000 UTC m=+1281.631284783"
Jul 16 22:11:22.326948 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.326920    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:22.455672 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455464    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-data\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.455672 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455521    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-credential-socket\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.455672 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455567    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-istio-token\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.455672 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455592    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cbb48f6-792c-4519-892f-f696b8df2337-istio-podinfo\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.455672 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455656    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cbb48f6-792c-4519-892f-f696b8df2337-istiod-ca-cert\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.456093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455692    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg7rt\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-kube-api-access-gg7rt\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.456093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455775    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-socket\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.456093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455817    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-envoy\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.456093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455858    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-certs\") pod \"3cbb48f6-792c-4519-892f-f696b8df2337\" (UID: \"3cbb48f6-792c-4519-892f-f696b8df2337\") "
Jul 16 22:11:22.456093 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.455902    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:22.456351 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.456117    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-data\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.456351 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.456186    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cbb48f6-792c-4519-892f-f696b8df2337-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:11:22.456351 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.456267    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:22.456803 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.456608    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:22.456803 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.456760    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:22.463198 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.463142    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:11:22.464673 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.464054    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cbb48f6-792c-4519-892f-f696b8df2337-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:11:22.464673 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.464138    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:22.467228 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.467059    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-kube-api-access-gg7rt" (OuterVolumeSpecName: "kube-api-access-gg7rt") pod "3cbb48f6-792c-4519-892f-f696b8df2337" (UID: "3cbb48f6-792c-4519-892f-f696b8df2337"). InnerVolumeSpecName "kube-api-access-gg7rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:11:22.557410 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.557365    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-istio-token\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.557410 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.557413    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cbb48f6-792c-4519-892f-f696b8df2337-istio-podinfo\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.557721 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.557432    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cbb48f6-792c-4519-892f-f696b8df2337-istiod-ca-cert\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.557721 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.557446    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg7rt\" (UniqueName: \"kubernetes.io/projected/3cbb48f6-792c-4519-892f-f696b8df2337-kube-api-access-gg7rt\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.557721 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.557461    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.557721 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.557475    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-istio-envoy\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.557721 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.557488    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-workload-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.557721 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.557500    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cbb48f6-792c-4519-892f-f696b8df2337-credential-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:22.994906 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:22.994860    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:23.086985 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.086951    2569 generic.go:356] "Generic (PLEG): container finished" podID="3cbb48f6-792c-4519-892f-f696b8df2337" containerID="688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a" exitCode=0
Jul 16 22:11:23.087412 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.086998    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"
Jul 16 22:11:23.087412 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.087038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb" event={"ID":"3cbb48f6-792c-4519-892f-f696b8df2337","Type":"ContainerDied","Data":"688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a"}
Jul 16 22:11:23.087412 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.087091    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb" event={"ID":"3cbb48f6-792c-4519-892f-f696b8df2337","Type":"ContainerDied","Data":"8f28f61749175ff9463ef8f9710eb6e2748be74d398c031922b5eb435c17cf23"}
Jul 16 22:11:23.087412 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.087112    2569 scope.go:117] "RemoveContainer" containerID="688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a"
Jul 16 22:11:23.095762 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.095741    2569 scope.go:117] "RemoveContainer" containerID="688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a"
Jul 16 22:11:23.096072 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:11:23.096049    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a\": container with ID starting with 688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a not found: ID does not exist" containerID="688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a"
Jul 16 22:11:23.096171 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.096078    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a"} err="failed to get container status \"688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a\": rpc error: code = NotFound desc = could not find container \"688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a\": container with ID starting with 688734beada353625171f204f112adc6b3096655da2bdd252f821f1356e9539a not found: ID does not exist"
Jul 16 22:11:23.106247 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.106220    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"]
Jul 16 22:11:23.108598 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:23.108574    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb"]
Jul 16 22:11:24.908787 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:24.908745    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cbb48f6-792c-4519-892f-f696b8df2337" path="/var/lib/kubelet/pods/3cbb48f6-792c-4519-892f-f696b8df2337/volumes"
Jul 16 22:11:30.994420 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:30.994380    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:31.007150 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.007121    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:31.128814 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.128782    2569 generic.go:356] "Generic (PLEG): container finished" podID="948fe0ac-4b9b-4f1e-af78-566dc115309e" containerID="e84ca9ed6934505853c9e5d0e18d0bb08cb2d0619b53a5ceaa4a706a5bd1b4d4" exitCode=0
Jul 16 22:11:31.128997 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.128850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" event={"ID":"948fe0ac-4b9b-4f1e-af78-566dc115309e","Type":"ContainerDied","Data":"e84ca9ed6934505853c9e5d0e18d0bb08cb2d0619b53a5ceaa4a706a5bd1b4d4"}
Jul 16 22:11:31.129302 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.129284    2569 scope.go:117] "RemoveContainer" containerID="e84ca9ed6934505853c9e5d0e18d0bb08cb2d0619b53a5ceaa4a706a5bd1b4d4"
Jul 16 22:11:31.130425 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.130389    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:11:31.130558 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.130469    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:11:31.130558 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.130517    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:11:31.140951 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.140927    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:31.725485 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:31.725452    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:11:32.138120 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:32.138075    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" event={"ID":"948fe0ac-4b9b-4f1e-af78-566dc115309e","Type":"ContainerStarted","Data":"6c8d1c40754c7bd1537b99d3ec706ca95e616a9c6c4c0a020a019cd4baf9f340"}
Jul 16 22:11:32.903319 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:32.903284    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:11:32.904474 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:32.904443    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" podUID="948fe0ac-4b9b-4f1e-af78-566dc115309e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 16 22:11:33.903091 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:33.903045    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" podUID="948fe0ac-4b9b-4f1e-af78-566dc115309e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 16 22:11:34.902975 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:34.902930    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" podUID="948fe0ac-4b9b-4f1e-af78-566dc115309e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 16 22:11:35.903170 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:35.903127    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" podUID="948fe0ac-4b9b-4f1e-af78-566dc115309e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 16 22:11:36.903255 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:36.903208    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm" podUID="948fe0ac-4b9b-4f1e-af78-566dc115309e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 16 22:11:37.907084 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:37.907055    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:11:37.907520 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:37.907300    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:11:37.908017 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:37.907998    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm"
Jul 16 22:11:38.193175 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:38.193081    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"]
Jul 16 22:11:38.220864 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:38.220834    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:11:53.213263 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.213218    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph" podUID="62a1de4e-7194-466b-8315-de5791efd462" containerName="main" containerID="cri-o://690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d" gracePeriod=45
Jul 16 22:11:53.476977 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.476908    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:53.551299 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551260    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-home\") pod \"62a1de4e-7194-466b-8315-de5791efd462\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") "
Jul 16 22:11:53.551467 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551370    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a1de4e-7194-466b-8315-de5791efd462-tls-certs\") pod \"62a1de4e-7194-466b-8315-de5791efd462\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") "
Jul 16 22:11:53.551467 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551405    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-model-cache\") pod \"62a1de4e-7194-466b-8315-de5791efd462\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") "
Jul 16 22:11:53.551574 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551555    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-tmp-dir\") pod \"62a1de4e-7194-466b-8315-de5791efd462\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") "
Jul 16 22:11:53.551653 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551563    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-home" (OuterVolumeSpecName: "home") pod "62a1de4e-7194-466b-8315-de5791efd462" (UID: "62a1de4e-7194-466b-8315-de5791efd462"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:53.551653 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551602    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm2db\" (UniqueName: \"kubernetes.io/projected/62a1de4e-7194-466b-8315-de5791efd462-kube-api-access-tm2db\") pod \"62a1de4e-7194-466b-8315-de5791efd462\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") "
Jul 16 22:11:53.551653 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551643    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-model-cache" (OuterVolumeSpecName: "model-cache") pod "62a1de4e-7194-466b-8315-de5791efd462" (UID: "62a1de4e-7194-466b-8315-de5791efd462"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:53.551802 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551652    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-dshm\") pod \"62a1de4e-7194-466b-8315-de5791efd462\" (UID: \"62a1de4e-7194-466b-8315-de5791efd462\") "
Jul 16 22:11:53.551802 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551760    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "62a1de4e-7194-466b-8315-de5791efd462" (UID: "62a1de4e-7194-466b-8315-de5791efd462"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:53.551944 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551927    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:53.552001 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551947    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:53.552001 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.551962    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:53.553455 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.553433    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a1de4e-7194-466b-8315-de5791efd462-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "62a1de4e-7194-466b-8315-de5791efd462" (UID: "62a1de4e-7194-466b-8315-de5791efd462"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:11:53.553535 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.553498    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a1de4e-7194-466b-8315-de5791efd462-kube-api-access-tm2db" (OuterVolumeSpecName: "kube-api-access-tm2db") pod "62a1de4e-7194-466b-8315-de5791efd462" (UID: "62a1de4e-7194-466b-8315-de5791efd462"). InnerVolumeSpecName "kube-api-access-tm2db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:11:53.553939 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.553922    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-dshm" (OuterVolumeSpecName: "dshm") pod "62a1de4e-7194-466b-8315-de5791efd462" (UID: "62a1de4e-7194-466b-8315-de5791efd462"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:11:53.653007 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.652967    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a1de4e-7194-466b-8315-de5791efd462-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:53.653007 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.653003    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm2db\" (UniqueName: \"kubernetes.io/projected/62a1de4e-7194-466b-8315-de5791efd462-kube-api-access-tm2db\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:53.653277 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:53.653018    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a1de4e-7194-466b-8315-de5791efd462-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:11:54.250960 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.250921    2569 generic.go:356] "Generic (PLEG): container finished" podID="62a1de4e-7194-466b-8315-de5791efd462" containerID="690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d" exitCode=0
Jul 16 22:11:54.251388 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.250968    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"
Jul 16 22:11:54.251388 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.250987    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph" event={"ID":"62a1de4e-7194-466b-8315-de5791efd462","Type":"ContainerDied","Data":"690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d"}
Jul 16 22:11:54.251388 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.251031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph" event={"ID":"62a1de4e-7194-466b-8315-de5791efd462","Type":"ContainerDied","Data":"b2b0caff9633540c95fee390a6b1412486700f20accfa18d1e4caa356a7a0e91"}
Jul 16 22:11:54.251388 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.251053    2569 scope.go:117] "RemoveContainer" containerID="690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d"
Jul 16 22:11:54.260500 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.260479    2569 scope.go:117] "RemoveContainer" containerID="690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d"
Jul 16 22:11:54.260835 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:11:54.260806    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d\": container with ID starting with 690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d not found: ID does not exist" containerID="690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d"
Jul 16 22:11:54.260957 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.260846    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d"} err="failed to get container status \"690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d\": rpc error: code = NotFound desc = could not find container \"690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d\": container with ID starting with 690c421bf09f3ee005bfad42348a8ad6a6055afe5b688263644c029d5b97f22d not found: ID does not exist"
Jul 16 22:11:54.277268 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.277236    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"]
Jul 16 22:11:54.280006 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.279977    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph"]
Jul 16 22:11:54.901138 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:11:54.901094    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a1de4e-7194-466b-8315-de5791efd462" path="/var/lib/kubelet/pods/62a1de4e-7194-466b-8315-de5791efd462/volumes"
Jul 16 22:12:02.291055 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:12:02.291012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:12:02.557373 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:12:02.557282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:12:05.470926 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:12:05.470892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:12:05.652315 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:12:05.652283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:12:14.781805 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:12:14.781764    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:12:36.396948 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:12:36.396862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:12:36.719735 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:12:36.719697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:12:55.316972 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:12:55.316930    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:13:05.548448 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:13:05.548411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:08.042407 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:08.042315    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:08.137369 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:08.137311    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:10.468647 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:10.468600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:10.554285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:10.554252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:19.281121 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:19.281085    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:19.381679 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:19.381642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:31.038034 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:31.037999    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:31.136606 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:31.136574    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:31.238449 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:31.238408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:33.668951 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:33.668915    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:33.769040 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:33.769008    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:34.253700 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:34.253666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:36.727186 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:36.727143    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:37.008949 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:37.008863    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:14:43.749309 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:14:43.749275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:15:01.805741 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:15:01.805704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:15:01.905743 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:15:01.905694    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:15:03.244926 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:15:03.244891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:15:14.043239 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:15:14.043195    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:15:29.846409 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:15:29.846320    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:16:54.956669 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:16:54.956511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:16:56.370076 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:16:56.370038    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:17:15.565534 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.565494    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"]
Jul 16 22:17:15.566226 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.565873    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cbb48f6-792c-4519-892f-f696b8df2337" containerName="istio-proxy"
Jul 16 22:17:15.566226 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.565888    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cbb48f6-792c-4519-892f-f696b8df2337" containerName="istio-proxy"
Jul 16 22:17:15.566226 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.565896    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a1de4e-7194-466b-8315-de5791efd462" containerName="main"
Jul 16 22:17:15.566226 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.565902    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a1de4e-7194-466b-8315-de5791efd462" containerName="main"
Jul 16 22:17:15.566226 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.565954    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cbb48f6-792c-4519-892f-f696b8df2337" containerName="istio-proxy"
Jul 16 22:17:15.566226 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.565968    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a1de4e-7194-466b-8315-de5791efd462" containerName="main"
Jul 16 22:17:15.569103 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.569075    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.581764 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.581730    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"]
Jul 16 22:17:15.604150 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.604150 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604157    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc9d997-3717-4e69-ba2a-1feef48eda86-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.604403 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604223    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.604403 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.604403 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.604403 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqc2w\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-kube-api-access-sqc2w\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.604403 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604378    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.604593 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604440    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.604593 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.604469    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.705762 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.705721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.705973 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.705770    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.705973 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.705812    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.705973 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.705840    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc9d997-3717-4e69-ba2a-1feef48eda86-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.705973 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.705897    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.705973 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.705938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.705973 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.705959    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.706289 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.705983    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqc2w\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-kube-api-access-sqc2w\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.706289 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.706021    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.706289 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.706161    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.706289 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.706233    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.706485 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.706424    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.706485 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.706453    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.706710 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.706691    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc9d997-3717-4e69-ba2a-1feef48eda86-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.708958 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.708924    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.709132 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.709112    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.714963 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.714928    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.715116 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.715066    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqc2w\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-kube-api-access-sqc2w\") pod \"router-gateway-1-openshift-default-799f46c59b-hd9rl\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:15.880387 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:15.880290    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:16.024648 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:16.024545    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"]
Jul 16 22:17:16.027411 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:17:16.027380    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc9d997_3717_4e69_ba2a_1feef48eda86.slice/crio-51366b795efea7505e1dbabb45b7aaf460e58a44afb7834dabd06a8aa7e8bfc5 WatchSource:0}: Error finding container 51366b795efea7505e1dbabb45b7aaf460e58a44afb7834dabd06a8aa7e8bfc5: Status 404 returned error can't find the container with id 51366b795efea7505e1dbabb45b7aaf460e58a44afb7834dabd06a8aa7e8bfc5
Jul 16 22:17:16.029560 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:16.029523    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:17:16.029663 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:16.029596    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:17:16.029663 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:16.029646    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:17:16.575299 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:16.575248    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl" event={"ID":"1cc9d997-3717-4e69-ba2a-1feef48eda86","Type":"ContainerStarted","Data":"1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36"}
Jul 16 22:17:16.575805 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:16.575354    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl" event={"ID":"1cc9d997-3717-4e69-ba2a-1feef48eda86","Type":"ContainerStarted","Data":"51366b795efea7505e1dbabb45b7aaf460e58a44afb7834dabd06a8aa7e8bfc5"}
Jul 16 22:17:16.599884 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:16.599822    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl" podStartSLOduration=1.5998045269999999 podStartE2EDuration="1.599804527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:17:16.598409379 +0000 UTC m=+1636.128952108" watchObservedRunningTime="2026-07-16 22:17:16.599804527 +0000 UTC m=+1636.130347253"
Jul 16 22:17:16.881222 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:16.881125    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:17.657387 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:17.657345    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"]
Jul 16 22:17:17.886453 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:17.886423    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:18.584812 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:18.584779    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:18.585759 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:18.585740    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:19.589212 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:19.589164    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl" podUID="1cc9d997-3717-4e69-ba2a-1feef48eda86" containerName="istio-proxy" containerID="cri-o://1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36" gracePeriod=30
Jul 16 22:17:28.248199 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.248169    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:28.330055 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.329951    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-token\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330055 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.329996    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-socket\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330055 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330019    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-data\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330341 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330073    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-envoy\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330341 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330205    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc9d997-3717-4e69-ba2a-1feef48eda86-istiod-ca-cert\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330341 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330249    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-podinfo\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330341 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330285    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-credential-socket\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330341 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330299    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:28.330579 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330341    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqc2w\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-kube-api-access-sqc2w\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330579 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330376    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-certs\") pod \"1cc9d997-3717-4e69-ba2a-1feef48eda86\" (UID: \"1cc9d997-3717-4e69-ba2a-1feef48eda86\") "
Jul 16 22:17:28.330579 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330420    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-data" (OuterVolumeSpecName: "istio-data") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:28.330770 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330607    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc9d997-3717-4e69-ba2a-1feef48eda86-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:17:28.330770 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330700    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:28.330878 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330765    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc9d997-3717-4e69-ba2a-1feef48eda86-istiod-ca-cert\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.330878 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330793    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.330878 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330806    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-data\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.330878 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.330845    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:28.332385 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.332348    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-token" (OuterVolumeSpecName: "istio-token") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:17:28.332520 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.332474    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-kube-api-access-sqc2w" (OuterVolumeSpecName: "kube-api-access-sqc2w") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "kube-api-access-sqc2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:17:28.332709 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.332683    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:28.332709 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.332688    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1cc9d997-3717-4e69-ba2a-1feef48eda86" (UID: "1cc9d997-3717-4e69-ba2a-1feef48eda86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:17:28.431269 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.431232    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-token\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.431269 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.431264    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-envoy\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.431269 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.431273    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc9d997-3717-4e69-ba2a-1feef48eda86-istio-podinfo\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.431534 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.431283    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-credential-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.431534 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.431305    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqc2w\" (UniqueName: \"kubernetes.io/projected/1cc9d997-3717-4e69-ba2a-1feef48eda86-kube-api-access-sqc2w\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.431534 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.431314    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc9d997-3717-4e69-ba2a-1feef48eda86-workload-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:17:28.631521 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.631428    2569 generic.go:356] "Generic (PLEG): container finished" podID="1cc9d997-3717-4e69-ba2a-1feef48eda86" containerID="1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36" exitCode=0
Jul 16 22:17:28.631521 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.631489    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"
Jul 16 22:17:28.631521 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.631510    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl" event={"ID":"1cc9d997-3717-4e69-ba2a-1feef48eda86","Type":"ContainerDied","Data":"1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36"}
Jul 16 22:17:28.631788 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.631589    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl" event={"ID":"1cc9d997-3717-4e69-ba2a-1feef48eda86","Type":"ContainerDied","Data":"51366b795efea7505e1dbabb45b7aaf460e58a44afb7834dabd06a8aa7e8bfc5"}
Jul 16 22:17:28.631788 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.631612    2569 scope.go:117] "RemoveContainer" containerID="1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36"
Jul 16 22:17:28.640889 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.640868    2569 scope.go:117] "RemoveContainer" containerID="1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36"
Jul 16 22:17:28.641263 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:17:28.641227    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36\": container with ID starting with 1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36 not found: ID does not exist" containerID="1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36"
Jul 16 22:17:28.641319 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.641265    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36"} err="failed to get container status \"1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36\": rpc error: code = NotFound desc = could not find container \"1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36\": container with ID starting with 1cfbe9c1ea58dd5f8c69c8d715c374514bbb06dccafad3d9b895f8c70948da36 not found: ID does not exist"
Jul 16 22:17:28.654457 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.654414    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"]
Jul 16 22:17:28.657986 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.657953    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl"]
Jul 16 22:17:28.900995 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:28.900915    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc9d997-3717-4e69-ba2a-1feef48eda86" path="/var/lib/kubelet/pods/1cc9d997-3717-4e69-ba2a-1feef48eda86/volumes"
Jul 16 22:17:40.725445 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:40.725409    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:17:41.474640 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:41.474591    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:17:41.575365 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:41.575331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:17:43.330707 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:43.330670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:17:43.391576 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:17:43.391540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:18:09.052241 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:18:09.052201    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:18:09.493524 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:18:09.493478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:18:14.886787 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:18:14.886754    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:19:51.713724 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:19:51.713658    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:19:51.799379 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:19:51.799335    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:19:58.246103 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:19:58.246065    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:20:20.346994 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:20:20.346944    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:20:20.703528 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:20:20.703489    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:20:50.472385 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:20:50.472344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:21:11.522520 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:21:11.522483    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:21:16.747157 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:21:16.747113    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:21:16.826269 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:21:16.826224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:21:48.981004 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:21:48.980934    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:21:49.087100 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:21:49.087047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:21:49.214006 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:21:49.213976    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:21:49.347020 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:21:49.346940    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:21:59.073518 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:21:59.073490    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:22:00.715767 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:22:00.715726    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:22:03.831742 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:22:03.831706    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:23:54.088884 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:23:54.088847    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:23:54.176861 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:23:54.176823    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:24:00.158335 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:24:00.158301    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:24:23.189835 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:24:23.189752    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:24:23.438479 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:24:23.438448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:24:34.524685 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:24:34.524650    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:19.942856 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:19.942825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:21.434784 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:21.434747    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:25.112025 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:25.111991    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:25.206026 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:25.205995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:40.939172 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:40.939142    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"]
Jul 16 22:27:40.939547 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:40.939451    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc9d997-3717-4e69-ba2a-1feef48eda86" containerName="istio-proxy"
Jul 16 22:27:40.939547 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:40.939463    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc9d997-3717-4e69-ba2a-1feef48eda86" containerName="istio-proxy"
Jul 16 22:27:40.939661 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:40.939562    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc9d997-3717-4e69-ba2a-1feef48eda86" containerName="istio-proxy"
Jul 16 22:27:40.942582 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:40.942565    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:40.946028 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:40.946012    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-xpspm\""
Jul 16 22:27:40.989582 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:40.989559    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"]
Jul 16 22:27:41.000328 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.000408 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.000408 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.000408 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000401    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.000512 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k2xl\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-kube-api-access-8k2xl\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.000512 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.000575 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.000575 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.000575 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.000565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.018807 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.018779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:41.101498 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.101690 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2xl\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-kube-api-access-8k2xl\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.101690 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101540    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.101690 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101562    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.101690 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.101690 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.101690 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.102053 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.102053 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101832    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.102053 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.101984    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.102053 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.102043    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.102222 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.102144    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.102277 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.102262    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.102437 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.102415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.104005 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.103980    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.104101 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.104083    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.115027 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.115008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k2xl\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-kube-api-access-8k2xl\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.115139 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.115119    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-dckx4\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.120105 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.120083    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:41.251991 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.251959    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:41.253542 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.253520    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"]
Jul 16 22:27:41.256583 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.256569    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.280786 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.280755    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"]
Jul 16 22:27:41.303669 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.303669 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.303669 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.303669 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303538    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.303669 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303564    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bvr5\" (UniqueName: \"kubernetes.io/projected/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-kube-api-access-5bvr5\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.303669 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.304069 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.304069 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.304069 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.303806    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.390442 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.390413    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"]
Jul 16 22:27:41.393528 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:27:41.393502    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbdc32b_ad72_467e_9b33_b3f2c383667c.slice/crio-91c65d167ced3665ae28dcf87f9318dc1ff982374eaab255a15d74fba1fff186 WatchSource:0}: Error finding container 91c65d167ced3665ae28dcf87f9318dc1ff982374eaab255a15d74fba1fff186: Status 404 returned error can't find the container with id 91c65d167ced3665ae28dcf87f9318dc1ff982374eaab255a15d74fba1fff186
Jul 16 22:27:41.395593 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.395559    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:41.395718 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.395653    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:41.395718 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.395682    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:41.404901 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.404880    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.404987 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.404912    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.404987 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.404939    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405069 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405216 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405231    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405264    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405451 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405342    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405507 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bvr5\" (UniqueName: \"kubernetes.io/projected/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-kube-api-access-5bvr5\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405507 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405489    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405610 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405684 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405636    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.405824 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.405809    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.407377 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.407349    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.407672 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.407645    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.414355 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.414324    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bvr5\" (UniqueName: \"kubernetes.io/projected/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-kube-api-access-5bvr5\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.414660 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.414639    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-mhvbh\" (UID: \"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.583125 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.583044    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:41.720398 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.720375    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"]
Jul 16 22:27:41.721875 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:27:41.721835    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ab4ee0_50ef_44a0_9dcd_1e3838a148d6.slice/crio-38c16c411fdd47f5792fe4bc9d7e83a9f87d43ee197cb0098d5c9daa483f4d8c WatchSource:0}: Error finding container 38c16c411fdd47f5792fe4bc9d7e83a9f87d43ee197cb0098d5c9daa483f4d8c: Status 404 returned error can't find the container with id 38c16c411fdd47f5792fe4bc9d7e83a9f87d43ee197cb0098d5c9daa483f4d8c
Jul 16 22:27:41.723868 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.723838    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:41.723945 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.723906    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:41.723945 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:41.723937    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:42.056714 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.056679    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4" event={"ID":"5dbdc32b-ad72-467e-9b33-b3f2c383667c","Type":"ContainerStarted","Data":"0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316"}
Jul 16 22:27:42.057178 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.056743    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4" event={"ID":"5dbdc32b-ad72-467e-9b33-b3f2c383667c","Type":"ContainerStarted","Data":"91c65d167ced3665ae28dcf87f9318dc1ff982374eaab255a15d74fba1fff186"}
Jul 16 22:27:42.058177 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.058154    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" event={"ID":"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6","Type":"ContainerStarted","Data":"c83e70b24780ea175d3aa0aa38ba97bbc5647280591801c3717b60e3998d4d81"}
Jul 16 22:27:42.058265 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.058193    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" event={"ID":"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6","Type":"ContainerStarted","Data":"38c16c411fdd47f5792fe4bc9d7e83a9f87d43ee197cb0098d5c9daa483f4d8c"}
Jul 16 22:27:42.092470 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.092428    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4" podStartSLOduration=2.092413031 podStartE2EDuration="2.092413031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:27:42.092120319 +0000 UTC m=+2261.622663047" watchObservedRunningTime="2026-07-16 22:27:42.092413031 +0000 UTC m=+2261.622955757"
Jul 16 22:27:42.252364 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.252329    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:42.256758 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.256736    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:42.290789 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.290742    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" podStartSLOduration=1.290730284 podStartE2EDuration="1.290730284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:27:42.143447148 +0000 UTC m=+2261.673989874" watchObservedRunningTime="2026-07-16 22:27:42.290730284 +0000 UTC m=+2261.821273011"
Jul 16 22:27:42.583773 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.583743    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:42.588505 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:42.588482    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:43.063169 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:43.063136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:43.063609 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:43.063189    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:43.063826 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:43.063809    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:43.063901 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:43.063858    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:43.152414 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:43.152379    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"]
Jul 16 22:27:44.900522 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:44.900479    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:45.071081 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:45.071043    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4" podUID="5dbdc32b-ad72-467e-9b33-b3f2c383667c" containerName="istio-proxy" containerID="cri-o://0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316" gracePeriod=30
Jul 16 22:27:49.441350 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:49.441317    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:50.016741 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.016708    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:50.118775 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.118752    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:27:50.328722 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.328701    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:50.396130 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396102    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-podinfo\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396329 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396147    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k2xl\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-kube-api-access-8k2xl\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396329 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396168    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-credential-socket\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396329 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396204    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-certs\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396329 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396246    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-socket\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396329 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396286    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istiod-ca-cert\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396329 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396313    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-data\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396329 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396333    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-envoy\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396362    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-token\") pod \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\" (UID: \"5dbdc32b-ad72-467e-9b33-b3f2c383667c\") "
Jul 16 22:27:50.396740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396510    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:27:50.396740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396692    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:27:50.396740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396699    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:27:50.396740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396517    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:27:50.396740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396717    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-credential-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:50.397055 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.396854    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-data" (OuterVolumeSpecName: "istio-data") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:27:50.398407 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.398378    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-kube-api-access-8k2xl" (OuterVolumeSpecName: "kube-api-access-8k2xl") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "kube-api-access-8k2xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:27:50.398509 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.398409    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-token" (OuterVolumeSpecName: "istio-token") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:27:50.398509 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.398433    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:27:50.398580 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.398541    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5dbdc32b-ad72-467e-9b33-b3f2c383667c" (UID: "5dbdc32b-ad72-467e-9b33-b3f2c383667c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:27:50.497986 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.497956    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-token\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:50.497986 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.497978    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-podinfo\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:50.497986 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.497988    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k2xl\" (UniqueName: \"kubernetes.io/projected/5dbdc32b-ad72-467e-9b33-b3f2c383667c-kube-api-access-8k2xl\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:50.498407 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.497998    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:50.498407 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.498006    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-workload-socket\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:50.498407 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.498015    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istiod-ca-cert\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:50.498407 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.498022    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-data\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:50.498407 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:50.498030    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbdc32b-ad72-467e-9b33-b3f2c383667c-istio-envoy\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:27:51.102411 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.102373    2569 generic.go:356] "Generic (PLEG): container finished" podID="5dbdc32b-ad72-467e-9b33-b3f2c383667c" containerID="0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316" exitCode=0
Jul 16 22:27:51.102602 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.102427    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"
Jul 16 22:27:51.102602 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.102459    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4" event={"ID":"5dbdc32b-ad72-467e-9b33-b3f2c383667c","Type":"ContainerDied","Data":"0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316"}
Jul 16 22:27:51.102602 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.102513    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4" event={"ID":"5dbdc32b-ad72-467e-9b33-b3f2c383667c","Type":"ContainerDied","Data":"91c65d167ced3665ae28dcf87f9318dc1ff982374eaab255a15d74fba1fff186"}
Jul 16 22:27:51.102602 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.102535    2569 scope.go:117] "RemoveContainer" containerID="0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316"
Jul 16 22:27:51.110828 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.110806    2569 scope.go:117] "RemoveContainer" containerID="0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316"
Jul 16 22:27:51.111078 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:27:51.111059    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316\": container with ID starting with 0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316 not found: ID does not exist" containerID="0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316"
Jul 16 22:27:51.111140 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.111091    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316"} err="failed to get container status \"0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316\": rpc error: code = NotFound desc = could not find container \"0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316\": container with ID starting with 0fbc177866916007e7aa3cb86d4ac56df30d649653b996faf884a4a7f6eb3316 not found: ID does not exist"
Jul 16 22:27:51.125052 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.125031    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"]
Jul 16 22:27:51.129009 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:51.128990    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4"]
Jul 16 22:27:52.903298 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:52.903261    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dbdc32b-ad72-467e-9b33-b3f2c383667c" path="/var/lib/kubelet/pods/5dbdc32b-ad72-467e-9b33-b3f2c383667c/volumes"
Jul 16 22:27:55.124447 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:55.124412    2569 generic.go:356] "Generic (PLEG): container finished" podID="b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6" containerID="c83e70b24780ea175d3aa0aa38ba97bbc5647280591801c3717b60e3998d4d81" exitCode=0
Jul 16 22:27:55.124447 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:55.124446    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" event={"ID":"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6","Type":"ContainerDied","Data":"c83e70b24780ea175d3aa0aa38ba97bbc5647280591801c3717b60e3998d4d81"}
Jul 16 22:27:55.124920 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:55.124789    2569 scope.go:117] "RemoveContainer" containerID="c83e70b24780ea175d3aa0aa38ba97bbc5647280591801c3717b60e3998d4d81"
Jul 16 22:27:55.125642 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:55.125601    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:55.125748 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:55.125693    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:55.125748 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:55.125741    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:27:56.130493 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:56.130455    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" event={"ID":"b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6","Type":"ContainerStarted","Data":"d7ee7b2a9fdae1cbb408081171878768c6a3e81f83647936f6dc14bb3621add2"}
Jul 16 22:27:56.583418 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:56.583378    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:56.584764 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:56.584726    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" podUID="b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:27:57.583715 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:57.583674    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" podUID="b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:27:58.062819 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:58.062784    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:27:58.583545 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:58.583512    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" podUID="b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:27:59.583608 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:27:59.583562    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" podUID="b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:28:00.584392 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:28:00.584348    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh" podUID="b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:28:01.588181 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:28:01.588144    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:28:01.589139 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:28:01.589120    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh"
Jul 16 22:28:10.017531 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:28:10.017498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:28:10.467711 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:28:10.467678    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:28:12.394235 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:28:12.394208    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:28:31.353347 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:28:31.353312    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:30:13.868668 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:30:13.868633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:30:16.852394 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:30:16.852348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:30:25.350096 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:30:25.350005    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:30:38.977166 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:30:38.977129    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:31:24.194583 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:31:24.194550    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:31:24.365905 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:31:24.365859    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:31:31.682187 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:31:31.682154    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:31:31.794807 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:31:31.794773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:31:31.895218 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:31:31.895187    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:31:45.212262 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:31:45.212232    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:31:45.635753 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:31:45.635714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:31:56.702360 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:31:56.702273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:32:18.895758 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:32:18.895723    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:34:17.231236 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:34:17.231202    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:34:19.390236 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:34:19.390190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:34:31.768169 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:34:31.768121    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:35:00.351777 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:35:00.351692    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:35:12.640719 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:35:12.640685    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:35:12.782105 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:35:12.782072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:35:12.866257 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:35:12.866218    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:35:13.420677 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:35:13.420644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:35:29.505325 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:35:29.505290    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:35:36.130595 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:35:36.130548    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:36:02.516657 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:36:02.516599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:36:46.795205 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:36:46.795165    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:37:30.523473 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:37:30.523440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:37:35.633913 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:37:35.633877    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:37:35.706426 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:37:35.706395    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:38:01.892338 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:38:01.892250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:38:17.447136 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:38:17.447087    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:38:35.179774 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:38:35.179719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:38:35.584303 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:38:35.584266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:38:39.324309 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:38:39.324271    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:38:39.424863 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:38:39.424822    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:38:42.863419 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:38:42.863385    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:39:08.781198 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:39:08.781167    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:39:08.866783 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:39:08.866746    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:39:37.205215 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:39:37.205176    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:39:38.638203 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:39:38.638166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:39:43.379905 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:39:43.379868    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:40:10.900443 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:40:10.900407    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:40:10.982490 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:40:10.982455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:40:27.754777 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:40:27.754744    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:40:39.472614 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:40:39.472579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:40:39.895101 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:40:39.894999    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:40:48.022214 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:40:48.022168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:40:55.011376 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:40:55.011293    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:40:55.326342 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:40:55.326245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:41:05.603056 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:05.603023    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:41:13.283682 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:13.283638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:41:13.386203 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:13.386155    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:41:43.793566 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.793534    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"]
Jul 16 22:41:43.794159 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.793876    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dbdc32b-ad72-467e-9b33-b3f2c383667c" containerName="istio-proxy"
Jul 16 22:41:43.794159 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.793890    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dbdc32b-ad72-467e-9b33-b3f2c383667c" containerName="istio-proxy"
Jul 16 22:41:43.794159 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.793944    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dbdc32b-ad72-467e-9b33-b3f2c383667c" containerName="istio-proxy"
Jul 16 22:41:43.796993 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.796976    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.800127 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.800107    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Jul 16 22:41:43.801179 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.801164    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:41:43.805865 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.805844    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"]
Jul 16 22:41:43.827868 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.827845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:41:43.847917 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.847897    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.848024 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.847927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8fl6\" (UniqueName: \"kubernetes.io/projected/b4df3108-46a4-480b-a0fc-b0536e4355aa-kube-api-access-f8fl6\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.848024 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.847954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.848024 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.847969    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.848024 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.847984    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.848185 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.848048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4df3108-46a4-480b-a0fc-b0536e4355aa-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.948863 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.948835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.949061 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.948867    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8fl6\" (UniqueName: \"kubernetes.io/projected/b4df3108-46a4-480b-a0fc-b0536e4355aa-kube-api-access-f8fl6\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.949061 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.948895    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.949061 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.948916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.949061 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.949025    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.949284 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.949127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4df3108-46a4-480b-a0fc-b0536e4355aa-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.949284 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.949263    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.949390 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.949335    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.949427 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.949399    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.951090 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.951073    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.951576 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.951555    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4df3108-46a4-480b-a0fc-b0536e4355aa-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:43.957407 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:43.957386    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8fl6\" (UniqueName: \"kubernetes.io/projected/b4df3108-46a4-480b-a0fc-b0536e4355aa-kube-api-access-f8fl6\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:44.107733 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:44.107646    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:44.169862 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:44.169788    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:41:44.258312 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:44.258237    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"]
Jul 16 22:41:44.261333 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:41:44.261268    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4df3108_46a4_480b_a0fc_b0536e4355aa.slice/crio-69dcef2a9f48b6958c66354b741e14c9434898a08096e1b494945caa115fb992 WatchSource:0}: Error finding container 69dcef2a9f48b6958c66354b741e14c9434898a08096e1b494945caa115fb992: Status 404 returned error can't find the container with id 69dcef2a9f48b6958c66354b741e14c9434898a08096e1b494945caa115fb992
Jul 16 22:41:44.691829 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:44.691789    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz" event={"ID":"b4df3108-46a4-480b-a0fc-b0536e4355aa","Type":"ContainerStarted","Data":"ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2"}
Jul 16 22:41:44.692013 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:44.691884    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz" event={"ID":"b4df3108-46a4-480b-a0fc-b0536e4355aa","Type":"ContainerStarted","Data":"69dcef2a9f48b6958c66354b741e14c9434898a08096e1b494945caa115fb992"}
Jul 16 22:41:44.733933 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:44.733888    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz" podStartSLOduration=1.733874573 podStartE2EDuration="1.733874573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:41:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:41:44.731801978 +0000 UTC m=+3104.262344715" watchObservedRunningTime="2026-07-16 22:41:44.733874573 +0000 UTC m=+3104.264417300"
Jul 16 22:41:45.107865 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:45.107827    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:51.807602 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:51.807568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:41:54.107872 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:54.107833    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:54.120236 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:54.120160    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:54.745768 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:54.745734    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:41:56.475736 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:41:56.475701    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:42:18.223721 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:18.223683    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:42:18.436874 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:18.436835    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"]
Jul 16 22:42:18.850190 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:18.850147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:42:33.456012 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.455971    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz" podUID="b4df3108-46a4-480b-a0fc-b0536e4355aa" containerName="main" containerID="cri-o://ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2" gracePeriod=45
Jul 16 22:42:33.700881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.700856    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:42:33.778487 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778414    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-model-cache\") pod \"b4df3108-46a4-480b-a0fc-b0536e4355aa\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") "
Jul 16 22:42:33.778487 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778447    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-home\") pod \"b4df3108-46a4-480b-a0fc-b0536e4355aa\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") "
Jul 16 22:42:33.778487 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778471    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-dshm\") pod \"b4df3108-46a4-480b-a0fc-b0536e4355aa\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") "
Jul 16 22:42:33.778789 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778490    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4df3108-46a4-480b-a0fc-b0536e4355aa-tls-certs\") pod \"b4df3108-46a4-480b-a0fc-b0536e4355aa\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") "
Jul 16 22:42:33.778789 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778533    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-tmp-dir\") pod \"b4df3108-46a4-480b-a0fc-b0536e4355aa\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") "
Jul 16 22:42:33.778789 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778585    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8fl6\" (UniqueName: \"kubernetes.io/projected/b4df3108-46a4-480b-a0fc-b0536e4355aa-kube-api-access-f8fl6\") pod \"b4df3108-46a4-480b-a0fc-b0536e4355aa\" (UID: \"b4df3108-46a4-480b-a0fc-b0536e4355aa\") "
Jul 16 22:42:33.778789 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778730    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "b4df3108-46a4-480b-a0fc-b0536e4355aa" (UID: "b4df3108-46a4-480b-a0fc-b0536e4355aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:33.778789 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778746    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-home" (OuterVolumeSpecName: "home") pod "b4df3108-46a4-480b-a0fc-b0536e4355aa" (UID: "b4df3108-46a4-480b-a0fc-b0536e4355aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:33.779006 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778860    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b4df3108-46a4-480b-a0fc-b0536e4355aa" (UID: "b4df3108-46a4-480b-a0fc-b0536e4355aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:33.779006 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.778985    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:42:33.779006 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.779002    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:42:33.779114 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.779016    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:42:33.780669 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.780646    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4df3108-46a4-480b-a0fc-b0536e4355aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b4df3108-46a4-480b-a0fc-b0536e4355aa" (UID: "b4df3108-46a4-480b-a0fc-b0536e4355aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:42:33.781038 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.781011    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-dshm" (OuterVolumeSpecName: "dshm") pod "b4df3108-46a4-480b-a0fc-b0536e4355aa" (UID: "b4df3108-46a4-480b-a0fc-b0536e4355aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:33.781125 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.781033    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4df3108-46a4-480b-a0fc-b0536e4355aa-kube-api-access-f8fl6" (OuterVolumeSpecName: "kube-api-access-f8fl6") pod "b4df3108-46a4-480b-a0fc-b0536e4355aa" (UID: "b4df3108-46a4-480b-a0fc-b0536e4355aa"). InnerVolumeSpecName "kube-api-access-f8fl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:42:33.879744 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.879712    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4df3108-46a4-480b-a0fc-b0536e4355aa-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:42:33.879744 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.879737    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4df3108-46a4-480b-a0fc-b0536e4355aa-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:42:33.879744 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.879749    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8fl6\" (UniqueName: \"kubernetes.io/projected/b4df3108-46a4-480b-a0fc-b0536e4355aa-kube-api-access-f8fl6\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:42:33.907253 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.907215    2569 generic.go:356] "Generic (PLEG): container finished" podID="b4df3108-46a4-480b-a0fc-b0536e4355aa" containerID="ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2" exitCode=0
Jul 16 22:42:33.907388 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.907277    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"
Jul 16 22:42:33.907388 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.907296    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz" event={"ID":"b4df3108-46a4-480b-a0fc-b0536e4355aa","Type":"ContainerDied","Data":"ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2"}
Jul 16 22:42:33.907388 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.907348    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz" event={"ID":"b4df3108-46a4-480b-a0fc-b0536e4355aa","Type":"ContainerDied","Data":"69dcef2a9f48b6958c66354b741e14c9434898a08096e1b494945caa115fb992"}
Jul 16 22:42:33.907388 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.907370    2569 scope.go:117] "RemoveContainer" containerID="ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2"
Jul 16 22:42:33.915555 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.915536    2569 scope.go:117] "RemoveContainer" containerID="ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2"
Jul 16 22:42:33.915809 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:42:33.915789    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2\": container with ID starting with ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2 not found: ID does not exist" containerID="ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2"
Jul 16 22:42:33.915858 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.915818    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2"} err="failed to get container status \"ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2\": rpc error: code = NotFound desc = could not find container \"ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2\": container with ID starting with ab0503e4f84b68266b3132607975ee8f895577d68815ef898bc0c134640fbef2 not found: ID does not exist"
Jul 16 22:42:33.939515 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.939495    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"]
Jul 16 22:42:33.950573 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:33.950551    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz"]
Jul 16 22:42:34.906526 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:34.906494    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4df3108-46a4-480b-a0fc-b0536e4355aa" path="/var/lib/kubelet/pods/b4df3108-46a4-480b-a0fc-b0536e4355aa/volumes"
Jul 16 22:42:45.867568 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:45.867529    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:42:46.125002 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.124921    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"]
Jul 16 22:42:46.125360 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.125340    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4df3108-46a4-480b-a0fc-b0536e4355aa" containerName="main"
Jul 16 22:42:46.125435 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.125361    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4df3108-46a4-480b-a0fc-b0536e4355aa" containerName="main"
Jul 16 22:42:46.125435 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.125425    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4df3108-46a4-480b-a0fc-b0536e4355aa" containerName="main"
Jul 16 22:42:46.127810 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.127792    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.135455 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.135436    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-epp-sa-dockercfg-g4p8d\""
Jul 16 22:42:46.135557 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.135473    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:42:46.135557 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.135543    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-kserve-self-signed-certs\""
Jul 16 22:42:46.145999 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.145962    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"]
Jul 16 22:42:46.182108 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.182072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:42:46.182395 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.182381    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.182486 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.182410    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.182486 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.182433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.182560 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.182516    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.182560 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.182542    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvxhx\" (UniqueName: \"kubernetes.io/projected/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-kube-api-access-kvxhx\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.283302 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.283274    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.283465 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.283310    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.283465 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.283333    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.283465 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.283383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.283465 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.283409    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvxhx\" (UniqueName: \"kubernetes.io/projected/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-kube-api-access-kvxhx\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.283824 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.283805    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.283925 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.283833    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.284007 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.283986    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.285768 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.285750    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.294580 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.294556    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvxhx\" (UniqueName: \"kubernetes.io/projected/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-kube-api-access-kvxhx\") pod \"scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.436859 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.436770    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:46.602367 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.602333    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"]
Jul 16 22:42:46.605280 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:42:46.605253    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf91f43_9be6_4495_9c11_c0a9be5bb97f.slice/crio-b6483d10ffd1fbbfd98b7fc98bc6143931f279f0ca6f4a9787e0f621b34b2400 WatchSource:0}: Error finding container b6483d10ffd1fbbfd98b7fc98bc6143931f279f0ca6f4a9787e0f621b34b2400: Status 404 returned error can't find the container with id b6483d10ffd1fbbfd98b7fc98bc6143931f279f0ca6f4a9787e0f621b34b2400
Jul 16 22:42:46.607323 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.607306    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:42:46.964883 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:46.964850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm" event={"ID":"dcf91f43-9be6-4495-9c11-c0a9be5bb97f","Type":"ContainerStarted","Data":"b6483d10ffd1fbbfd98b7fc98bc6143931f279f0ca6f4a9787e0f621b34b2400"}
Jul 16 22:42:49.980359 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:49.980319    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm" event={"ID":"dcf91f43-9be6-4495-9c11-c0a9be5bb97f","Type":"ContainerStarted","Data":"d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e"}
Jul 16 22:42:49.980849 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:49.980419    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:42:50.003747 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:50.003700    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm" podStartSLOduration=1.38132689 podStartE2EDuration="4.00368649s" totalImagesPullingTime="2.6223596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:50.000856887 +0000 UTC m=+3169.531399613" watchObservedRunningTime="2026-07-16 22:42:50.00368649 +0000 UTC m=+3169.534229230"
Jul 16 22:42:53.006168 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:53.006131    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:42:59.642449 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:59.642408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:42:59.723179 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:42:59.723147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:43:20.986414 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:20.986385    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:43:24.330444 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:24.330403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:43:24.751790 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:24.751759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:43:40.317428 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:40.317382    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:43:41.254866 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:41.254826    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:43:41.328431 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:41.328398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:43:41.732807 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:41.732777    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"]
Jul 16 22:43:41.751506 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:41.751474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:43:41.890774 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:41.890741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:43:50.986775 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:50.986735    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm" podUID="dcf91f43-9be6-4495-9c11-c0a9be5bb97f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 16 22:43:56.752830 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:56.752744    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm" podUID="dcf91f43-9be6-4495-9c11-c0a9be5bb97f" containerName="main" containerID="cri-o://d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e" gracePeriod=45
Jul 16 22:43:56.992711 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:56.992687    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:43:57.093542 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.093454    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-uds\") pod \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") "
Jul 16 22:43:57.093542 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.093518    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvxhx\" (UniqueName: \"kubernetes.io/projected/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-kube-api-access-kvxhx\") pod \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") "
Jul 16 22:43:57.093542 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.093540    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-cache\") pod \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") "
Jul 16 22:43:57.093819 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.093558    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-cachi2-cache\") pod \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") "
Jul 16 22:43:57.093819 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.093603    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tls-certs\") pod \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\" (UID: \"dcf91f43-9be6-4495-9c11-c0a9be5bb97f\") "
Jul 16 22:43:57.093930 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.093872    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-cachi2-cache" (OuterVolumeSpecName: "cachi2-cache") pod "dcf91f43-9be6-4495-9c11-c0a9be5bb97f" (UID: "dcf91f43-9be6-4495-9c11-c0a9be5bb97f"). InnerVolumeSpecName "cachi2-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:43:57.093930 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.093848    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "dcf91f43-9be6-4495-9c11-c0a9be5bb97f" (UID: "dcf91f43-9be6-4495-9c11-c0a9be5bb97f"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:43:57.093930 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.093907    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "dcf91f43-9be6-4495-9c11-c0a9be5bb97f" (UID: "dcf91f43-9be6-4495-9c11-c0a9be5bb97f"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:43:57.095689 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.095665    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dcf91f43-9be6-4495-9c11-c0a9be5bb97f" (UID: "dcf91f43-9be6-4495-9c11-c0a9be5bb97f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:43:57.095770 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.095667    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-kube-api-access-kvxhx" (OuterVolumeSpecName: "kube-api-access-kvxhx") pod "dcf91f43-9be6-4495-9c11-c0a9be5bb97f" (UID: "dcf91f43-9be6-4495-9c11-c0a9be5bb97f"). InnerVolumeSpecName "kube-api-access-kvxhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:43:57.194645 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.194590    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-uds\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:43:57.194645 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.194639    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvxhx\" (UniqueName: \"kubernetes.io/projected/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-kube-api-access-kvxhx\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:43:57.194645 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.194649    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tokenizer-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:43:57.194875 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.194660    2569 reconciler_common.go:299] "Volume detached for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-cachi2-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:43:57.194875 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.194668    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf91f43-9be6-4495-9c11-c0a9be5bb97f-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:43:57.269262 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.269226    2569 generic.go:356] "Generic (PLEG): container finished" podID="dcf91f43-9be6-4495-9c11-c0a9be5bb97f" containerID="d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e" exitCode=0
Jul 16 22:43:57.269423 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.269272    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"
Jul 16 22:43:57.269423 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.269296    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm" event={"ID":"dcf91f43-9be6-4495-9c11-c0a9be5bb97f","Type":"ContainerDied","Data":"d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e"}
Jul 16 22:43:57.269423 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.269335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm" event={"ID":"dcf91f43-9be6-4495-9c11-c0a9be5bb97f","Type":"ContainerDied","Data":"b6483d10ffd1fbbfd98b7fc98bc6143931f279f0ca6f4a9787e0f621b34b2400"}
Jul 16 22:43:57.269423 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.269355    2569 scope.go:117] "RemoveContainer" containerID="d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e"
Jul 16 22:43:57.278992 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.278972    2569 scope.go:117] "RemoveContainer" containerID="d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e"
Jul 16 22:43:57.279237 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:43:57.279216    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e\": container with ID starting with d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e not found: ID does not exist" containerID="d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e"
Jul 16 22:43:57.279333 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.279241    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e"} err="failed to get container status \"d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e\": rpc error: code = NotFound desc = could not find container \"d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e\": container with ID starting with d9d0fb49d3022d8f5324e6b0924ce6d728e3345b620c17f2f8dec00b81c0887e not found: ID does not exist"
Jul 16 22:43:57.296032 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.296007    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"]
Jul 16 22:43:57.307786 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:57.307761    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm"]
Jul 16 22:43:58.901056 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:43:58.901025    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf91f43-9be6-4495-9c11-c0a9be5bb97f" path="/var/lib/kubelet/pods/dcf91f43-9be6-4495-9c11-c0a9be5bb97f/volumes"
Jul 16 22:44:07.586548 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.586512    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"]
Jul 16 22:44:07.587076 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.587061    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf91f43-9be6-4495-9c11-c0a9be5bb97f" containerName="main"
Jul 16 22:44:07.587146 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.587081    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf91f43-9be6-4495-9c11-c0a9be5bb97f" containerName="main"
Jul 16 22:44:07.587201 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.587177    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf91f43-9be6-4495-9c11-c0a9be5bb97f" containerName="main"
Jul 16 22:44:07.591733 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.591713    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.596642 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.594934    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:44:07.596642 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.596121    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Jul 16 22:44:07.596642 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.596382    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-dockercfg-c2jqp\""
Jul 16 22:44:07.609988 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.609959    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"]
Jul 16 22:44:07.628252 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.628218    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:44:07.688679 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.688649    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.688679 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.688686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f512b694-676f-43c1-8a45-8586b4161dc6-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.688944 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.688731    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.688944 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.688850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.688944 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.688903    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9tc6\" (UniqueName: \"kubernetes.io/projected/f512b694-676f-43c1-8a45-8586b4161dc6-kube-api-access-b9tc6\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.689063 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.688947    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-home\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789313 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789313 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789316    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9tc6\" (UniqueName: \"kubernetes.io/projected/f512b694-676f-43c1-8a45-8586b4161dc6-kube-api-access-b9tc6\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789576 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789339    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-home\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789576 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789576 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789385    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f512b694-676f-43c1-8a45-8586b4161dc6-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789576 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789457    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789826 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789722    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-home\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789913 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789820    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.789913 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.789858    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.791688 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.791666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.791793 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.791776    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f512b694-676f-43c1-8a45-8586b4161dc6-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.799475 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.799452    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9tc6\" (UniqueName: \"kubernetes.io/projected/f512b694-676f-43c1-8a45-8586b4161dc6-kube-api-access-b9tc6\") pod \"scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.902836 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.902744    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:07.928606 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:07.928561    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:44:08.058211 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:08.058179    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"]
Jul 16 22:44:08.061073 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:44:08.061046    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf512b694_676f_43c1_8a45_8586b4161dc6.slice/crio-c0547d04f7184bd3504ef08084e6d3d5a6ceba8e21e1c9f81563d76199c03c8a WatchSource:0}: Error finding container c0547d04f7184bd3504ef08084e6d3d5a6ceba8e21e1c9f81563d76199c03c8a: Status 404 returned error can't find the container with id c0547d04f7184bd3504ef08084e6d3d5a6ceba8e21e1c9f81563d76199c03c8a
Jul 16 22:44:08.321739 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:08.321706    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" event={"ID":"f512b694-676f-43c1-8a45-8586b4161dc6","Type":"ContainerStarted","Data":"c0547d04f7184bd3504ef08084e6d3d5a6ceba8e21e1c9f81563d76199c03c8a"}
Jul 16 22:44:10.331556 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:10.331523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" event={"ID":"f512b694-676f-43c1-8a45-8586b4161dc6","Type":"ContainerStarted","Data":"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4"}
Jul 16 22:44:10.332029 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:10.331660    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:11.337885 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:11.337847    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" event={"ID":"f512b694-676f-43c1-8a45-8586b4161dc6","Type":"ContainerStarted","Data":"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9"}
Jul 16 22:44:11.361302 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:11.361254    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" podStartSLOduration=2.878011175 podStartE2EDuration="4.36123911s" totalImagesPullingTime="1.483227935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:44:11.358801765 +0000 UTC m=+3250.889344492" watchObservedRunningTime="2026-07-16 22:44:11.36123911 +0000 UTC m=+3250.891781837"
Jul 16 22:44:11.903138 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:11.903105    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:17.903328 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:17.903294    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:17.915355 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:17.915334    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:18.377645 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:18.377596    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:19.382381 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:19.382352    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:36.872502 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:36.872462    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:44:41.691831 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:41.691796    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"]
Jul 16 22:44:41.692773 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:41.692741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:44:42.780585 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:42.780552    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:44:56.715855 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:56.715798    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" containerName="main" containerID="cri-o://6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9" gracePeriod=45
Jul 16 22:44:56.832941 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:56.832912    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" containerName="llm-d-routing-sidecar" containerID="cri-o://da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4" gracePeriod=45
Jul 16 22:44:57.079383 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.079363    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:57.202876 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.202844    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-tmp-dir\") pod \"f512b694-676f-43c1-8a45-8586b4161dc6\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") "
Jul 16 22:44:57.203037 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.202896    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f512b694-676f-43c1-8a45-8586b4161dc6-tls-certs\") pod \"f512b694-676f-43c1-8a45-8586b4161dc6\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") "
Jul 16 22:44:57.203037 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.202927    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-model-cache\") pod \"f512b694-676f-43c1-8a45-8586b4161dc6\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") "
Jul 16 22:44:57.203037 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.202957    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-dshm\") pod \"f512b694-676f-43c1-8a45-8586b4161dc6\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") "
Jul 16 22:44:57.203037 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.202986    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-home\") pod \"f512b694-676f-43c1-8a45-8586b4161dc6\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") "
Jul 16 22:44:57.203037 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.203016    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9tc6\" (UniqueName: \"kubernetes.io/projected/f512b694-676f-43c1-8a45-8586b4161dc6-kube-api-access-b9tc6\") pod \"f512b694-676f-43c1-8a45-8586b4161dc6\" (UID: \"f512b694-676f-43c1-8a45-8586b4161dc6\") "
Jul 16 22:44:57.203303 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.203122    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f512b694-676f-43c1-8a45-8586b4161dc6" (UID: "f512b694-676f-43c1-8a45-8586b4161dc6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:44:57.203303 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.203269    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:44:57.203303 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.203286    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-model-cache" (OuterVolumeSpecName: "model-cache") pod "f512b694-676f-43c1-8a45-8586b4161dc6" (UID: "f512b694-676f-43c1-8a45-8586b4161dc6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:44:57.203455 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.203328    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-home" (OuterVolumeSpecName: "home") pod "f512b694-676f-43c1-8a45-8586b4161dc6" (UID: "f512b694-676f-43c1-8a45-8586b4161dc6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:44:57.205135 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.205109    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f512b694-676f-43c1-8a45-8586b4161dc6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f512b694-676f-43c1-8a45-8586b4161dc6" (UID: "f512b694-676f-43c1-8a45-8586b4161dc6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:44:57.205135 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.205106    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f512b694-676f-43c1-8a45-8586b4161dc6-kube-api-access-b9tc6" (OuterVolumeSpecName: "kube-api-access-b9tc6") pod "f512b694-676f-43c1-8a45-8586b4161dc6" (UID: "f512b694-676f-43c1-8a45-8586b4161dc6"). InnerVolumeSpecName "kube-api-access-b9tc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:44:57.205285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.205111    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-dshm" (OuterVolumeSpecName: "dshm") pod "f512b694-676f-43c1-8a45-8586b4161dc6" (UID: "f512b694-676f-43c1-8a45-8586b4161dc6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:44:57.303963 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.303904    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f512b694-676f-43c1-8a45-8586b4161dc6-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:44:57.303963 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.303929    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:44:57.303963 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.303937    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:44:57.303963 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.303944    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f512b694-676f-43c1-8a45-8586b4161dc6-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:44:57.303963 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.303953    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9tc6\" (UniqueName: \"kubernetes.io/projected/f512b694-676f-43c1-8a45-8586b4161dc6-kube-api-access-b9tc6\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:44:57.537535 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.537504    2569 generic.go:356] "Generic (PLEG): container finished" podID="f512b694-676f-43c1-8a45-8586b4161dc6" containerID="6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9" exitCode=0
Jul 16 22:44:57.537535 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.537528    2569 generic.go:356] "Generic (PLEG): container finished" podID="f512b694-676f-43c1-8a45-8586b4161dc6" containerID="da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4" exitCode=0
Jul 16 22:44:57.537761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.537554    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"
Jul 16 22:44:57.537761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.537598    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" event={"ID":"f512b694-676f-43c1-8a45-8586b4161dc6","Type":"ContainerDied","Data":"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9"}
Jul 16 22:44:57.537761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.537669    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" event={"ID":"f512b694-676f-43c1-8a45-8586b4161dc6","Type":"ContainerDied","Data":"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4"}
Jul 16 22:44:57.537761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.537686    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz" event={"ID":"f512b694-676f-43c1-8a45-8586b4161dc6","Type":"ContainerDied","Data":"c0547d04f7184bd3504ef08084e6d3d5a6ceba8e21e1c9f81563d76199c03c8a"}
Jul 16 22:44:57.537761 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.537707    2569 scope.go:117] "RemoveContainer" containerID="6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9"
Jul 16 22:44:57.546335 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.546313    2569 scope.go:117] "RemoveContainer" containerID="da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4"
Jul 16 22:44:57.553370 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.553354    2569 scope.go:117] "RemoveContainer" containerID="6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9"
Jul 16 22:44:57.553594 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:44:57.553577    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9\": container with ID starting with 6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9 not found: ID does not exist" containerID="6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9"
Jul 16 22:44:57.553694 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.553600    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9"} err="failed to get container status \"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9\": rpc error: code = NotFound desc = could not find container \"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9\": container with ID starting with 6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9 not found: ID does not exist"
Jul 16 22:44:57.553694 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.553630    2569 scope.go:117] "RemoveContainer" containerID="da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4"
Jul 16 22:44:57.553850 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:44:57.553836    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4\": container with ID starting with da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4 not found: ID does not exist" containerID="da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4"
Jul 16 22:44:57.553892 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.553855    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4"} err="failed to get container status \"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4\": rpc error: code = NotFound desc = could not find container \"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4\": container with ID starting with da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4 not found: ID does not exist"
Jul 16 22:44:57.553892 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.553870    2569 scope.go:117] "RemoveContainer" containerID="6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9"
Jul 16 22:44:57.554090 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.554051    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9"} err="failed to get container status \"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9\": rpc error: code = NotFound desc = could not find container \"6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9\": container with ID starting with 6cff092cf0b22920c282b792675ade4ceb2beb37fbd04494c2899164b29c87c9 not found: ID does not exist"
Jul 16 22:44:57.554090 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.554081    2569 scope.go:117] "RemoveContainer" containerID="da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4"
Jul 16 22:44:57.554275 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.554257    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4"} err="failed to get container status \"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4\": rpc error: code = NotFound desc = could not find container \"da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4\": container with ID starting with da21f3f931ebb0d915e1cb5e2136e2f640f76d28b048ec3fb018a8e83a1bc8a4 not found: ID does not exist"
Jul 16 22:44:57.559807 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.559786    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"]
Jul 16 22:44:57.564104 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:57.564087    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz"]
Jul 16 22:44:58.901363 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:44:58.901325    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" path="/var/lib/kubelet/pods/f512b694-676f-43c1-8a45-8586b4161dc6/volumes"
Jul 16 22:45:06.334821 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.334788    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"]
Jul 16 22:45:06.335234 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.335142    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" containerName="main"
Jul 16 22:45:06.335234 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.335154    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" containerName="main"
Jul 16 22:45:06.335234 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.335162    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" containerName="llm-d-routing-sidecar"
Jul 16 22:45:06.335234 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.335167    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" containerName="llm-d-routing-sidecar"
Jul 16 22:45:06.335234 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.335219    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" containerName="llm-d-routing-sidecar"
Jul 16 22:45:06.335234 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.335232    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f512b694-676f-43c1-8a45-8586b4161dc6" containerName="main"
Jul 16 22:45:06.340311 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.340290    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.344282 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.344262    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-dockercfg-hxq4k\""
Jul 16 22:45:06.344396 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.344266    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:45:06.344396 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.344305    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Jul 16 22:45:06.351897 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.351875    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"]
Jul 16 22:45:06.383446 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.383419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-home\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.383575 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.383464    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs2dl\" (UniqueName: \"kubernetes.io/projected/f07a3840-118b-4d7e-a1de-0b637506a327-kube-api-access-rs2dl\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.383575 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.383512    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.383575 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.383569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.383727 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.383598    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.383727 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.383659    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07a3840-118b-4d7e-a1de-0b637506a327-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.484938 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.484905    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2dl\" (UniqueName: \"kubernetes.io/projected/f07a3840-118b-4d7e-a1de-0b637506a327-kube-api-access-rs2dl\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.485132 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.484950    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.485132 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.484978    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.485132 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.485003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.485132 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.485030    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07a3840-118b-4d7e-a1de-0b637506a327-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.485132 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.485066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-home\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.485417 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.485394    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.485417 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.485410    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.485492 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.485463    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-home\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.487267 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.487241    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.487591 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.487575    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07a3840-118b-4d7e-a1de-0b637506a327-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.495261 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.495234    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs2dl\" (UniqueName: \"kubernetes.io/projected/f07a3840-118b-4d7e-a1de-0b637506a327-kube-api-access-rs2dl\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.650353 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.650255    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:06.799782 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:06.799748    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"]
Jul 16 22:45:06.802703 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:45:06.802677    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf07a3840_118b_4d7e_a1de_0b637506a327.slice/crio-5ec394f02e6519576e002a55b942ea4490de4ffa9e04c12698256c2a7b7a3176 WatchSource:0}: Error finding container 5ec394f02e6519576e002a55b942ea4490de4ffa9e04c12698256c2a7b7a3176: Status 404 returned error can't find the container with id 5ec394f02e6519576e002a55b942ea4490de4ffa9e04c12698256c2a7b7a3176
Jul 16 22:45:07.349272 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:07.349239    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:45:07.448409 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:07.448373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:45:07.590380 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:07.590351    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" event={"ID":"f07a3840-118b-4d7e-a1de-0b637506a327","Type":"ContainerStarted","Data":"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539"}
Jul 16 22:45:07.590602 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:07.590405    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:07.590602 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:07.590424    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" event={"ID":"f07a3840-118b-4d7e-a1de-0b637506a327","Type":"ContainerStarted","Data":"5ec394f02e6519576e002a55b942ea4490de4ffa9e04c12698256c2a7b7a3176"}
Jul 16 22:45:08.597547 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:08.597512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" event={"ID":"f07a3840-118b-4d7e-a1de-0b637506a327","Type":"ContainerStarted","Data":"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906"}
Jul 16 22:45:08.650902 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:08.650876    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:16.650999 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:16.650963    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:16.663063 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:16.663036    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:16.664395 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:16.664376    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:16.689063 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:16.689022    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" podStartSLOduration=10.689009415 podStartE2EDuration="10.689009415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:45:08.628860878 +0000 UTC m=+3308.159403609" watchObservedRunningTime="2026-07-16 22:45:16.689009415 +0000 UTC m=+3316.219552141"
Jul 16 22:45:17.646694 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:17.646666    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:23.822403 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:23.822323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:45:40.238699 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:40.238665    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"]
Jul 16 22:45:40.249823 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:40.249799    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:45:40.340322 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:40.340292    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:45:44.461190 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:44.461154    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:45:44.595159 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:44.595107    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:45:55.258499 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.258437    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" containerName="main" containerID="cri-o://37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906" gracePeriod=45
Jul 16 22:45:55.368788 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.368742    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" containerName="llm-d-routing-sidecar" containerID="cri-o://7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539" gracePeriod=45
Jul 16 22:45:55.605238 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.605213    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:55.794681 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.794584    2569 generic.go:356] "Generic (PLEG): container finished" podID="f07a3840-118b-4d7e-a1de-0b637506a327" containerID="37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906" exitCode=0
Jul 16 22:45:55.794681 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.794612    2569 generic.go:356] "Generic (PLEG): container finished" podID="f07a3840-118b-4d7e-a1de-0b637506a327" containerID="7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539" exitCode=0
Jul 16 22:45:55.794681 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.794649    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" event={"ID":"f07a3840-118b-4d7e-a1de-0b637506a327","Type":"ContainerDied","Data":"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906"}
Jul 16 22:45:55.794681 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.794668    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"
Jul 16 22:45:55.794979 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.794734    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" event={"ID":"f07a3840-118b-4d7e-a1de-0b637506a327","Type":"ContainerDied","Data":"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539"}
Jul 16 22:45:55.794979 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.794753    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz" event={"ID":"f07a3840-118b-4d7e-a1de-0b637506a327","Type":"ContainerDied","Data":"5ec394f02e6519576e002a55b942ea4490de4ffa9e04c12698256c2a7b7a3176"}
Jul 16 22:45:55.794979 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.794773    2569 scope.go:117] "RemoveContainer" containerID="37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906"
Jul 16 22:45:55.796839 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.796821    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-home\") pod \"f07a3840-118b-4d7e-a1de-0b637506a327\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") "
Jul 16 22:45:55.796927 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.796849    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-dshm\") pod \"f07a3840-118b-4d7e-a1de-0b637506a327\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") "
Jul 16 22:45:55.796927 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.796905    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07a3840-118b-4d7e-a1de-0b637506a327-tls-certs\") pod \"f07a3840-118b-4d7e-a1de-0b637506a327\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") "
Jul 16 22:45:55.797037 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.796989    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-tmp-dir\") pod \"f07a3840-118b-4d7e-a1de-0b637506a327\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") "
Jul 16 22:45:55.797037 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.797023    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs2dl\" (UniqueName: \"kubernetes.io/projected/f07a3840-118b-4d7e-a1de-0b637506a327-kube-api-access-rs2dl\") pod \"f07a3840-118b-4d7e-a1de-0b637506a327\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") "
Jul 16 22:45:55.797143 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.797075    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-model-cache\") pod \"f07a3840-118b-4d7e-a1de-0b637506a327\" (UID: \"f07a3840-118b-4d7e-a1de-0b637506a327\") "
Jul 16 22:45:55.797143 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.797106    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-home" (OuterVolumeSpecName: "home") pod "f07a3840-118b-4d7e-a1de-0b637506a327" (UID: "f07a3840-118b-4d7e-a1de-0b637506a327"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.797285 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.797259    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f07a3840-118b-4d7e-a1de-0b637506a327" (UID: "f07a3840-118b-4d7e-a1de-0b637506a327"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.797338 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.797297    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.797424 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.797395    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-model-cache" (OuterVolumeSpecName: "model-cache") pod "f07a3840-118b-4d7e-a1de-0b637506a327" (UID: "f07a3840-118b-4d7e-a1de-0b637506a327"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.798972 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.798947    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-dshm" (OuterVolumeSpecName: "dshm") pod "f07a3840-118b-4d7e-a1de-0b637506a327" (UID: "f07a3840-118b-4d7e-a1de-0b637506a327"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.799121 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.799094    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07a3840-118b-4d7e-a1de-0b637506a327-kube-api-access-rs2dl" (OuterVolumeSpecName: "kube-api-access-rs2dl") pod "f07a3840-118b-4d7e-a1de-0b637506a327" (UID: "f07a3840-118b-4d7e-a1de-0b637506a327"). InnerVolumeSpecName "kube-api-access-rs2dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:45:55.799227 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.799124    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f07a3840-118b-4d7e-a1de-0b637506a327-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f07a3840-118b-4d7e-a1de-0b637506a327" (UID: "f07a3840-118b-4d7e-a1de-0b637506a327"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:45:55.802680 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.802661    2569 scope.go:117] "RemoveContainer" containerID="7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539"
Jul 16 22:45:55.810007 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.809993    2569 scope.go:117] "RemoveContainer" containerID="37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906"
Jul 16 22:45:55.810268 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:45:55.810248    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906\": container with ID starting with 37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906 not found: ID does not exist" containerID="37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906"
Jul 16 22:45:55.810334 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.810280    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906"} err="failed to get container status \"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906\": rpc error: code = NotFound desc = could not find container \"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906\": container with ID starting with 37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906 not found: ID does not exist"
Jul 16 22:45:55.810334 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.810299    2569 scope.go:117] "RemoveContainer" containerID="7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539"
Jul 16 22:45:55.810519 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:45:55.810503    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539\": container with ID starting with 7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539 not found: ID does not exist" containerID="7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539"
Jul 16 22:45:55.810560 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.810524    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539"} err="failed to get container status \"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539\": rpc error: code = NotFound desc = could not find container \"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539\": container with ID starting with 7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539 not found: ID does not exist"
Jul 16 22:45:55.810560 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.810538    2569 scope.go:117] "RemoveContainer" containerID="37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906"
Jul 16 22:45:55.810766 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.810742    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906"} err="failed to get container status \"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906\": rpc error: code = NotFound desc = could not find container \"37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906\": container with ID starting with 37775c0a315cb5f2ff7edd545c6197e5901d52637a15b22b66d92a3482397906 not found: ID does not exist"
Jul 16 22:45:55.810828 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.810767    2569 scope.go:117] "RemoveContainer" containerID="7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539"
Jul 16 22:45:55.810975 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.810958    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539"} err="failed to get container status \"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539\": rpc error: code = NotFound desc = could not find container \"7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539\": container with ID starting with 7abd451ccfdfb2fa7dcdd3664e1a745b872005800f9d553399875a53cb410539 not found: ID does not exist"
Jul 16 22:45:55.897783 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.897762    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.897783 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.897781    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs2dl\" (UniqueName: \"kubernetes.io/projected/f07a3840-118b-4d7e-a1de-0b637506a327-kube-api-access-rs2dl\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.897901 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.897790    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.897901 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.897800    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f07a3840-118b-4d7e-a1de-0b637506a327-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.897901 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:55.897807    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07a3840-118b-4d7e-a1de-0b637506a327-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:45:56.118368 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:56.118340    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"]
Jul 16 22:45:56.122835 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:56.122811    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz"]
Jul 16 22:45:56.901162 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:45:56.901125    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" path="/var/lib/kubelet/pods/f07a3840-118b-4d7e-a1de-0b637506a327/volumes"
Jul 16 22:46:58.407870 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:46:58.407833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:46:58.920078 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:46:58.920045    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:47:23.170481 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:23.170446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:47:31.796057 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.796020    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"]
Jul 16 22:47:31.796558 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.796345    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" containerName="llm-d-routing-sidecar"
Jul 16 22:47:31.796558 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.796357    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" containerName="llm-d-routing-sidecar"
Jul 16 22:47:31.796558 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.796370    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" containerName="main"
Jul 16 22:47:31.796558 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.796375    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" containerName="main"
Jul 16 22:47:31.796558 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.796443    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" containerName="llm-d-routing-sidecar"
Jul 16 22:47:31.796558 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.796453    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f07a3840-118b-4d7e-a1de-0b637506a327" containerName="main"
Jul 16 22:47:31.799398 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.799379    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.803404 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.803384    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Jul 16 22:47:31.803509 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.803386    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l648x\""
Jul 16 22:47:31.810574 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.810552    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"]
Jul 16 22:47:31.890741 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.890709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.890876 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.890774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qj24\" (UniqueName: \"kubernetes.io/projected/bfa7b3db-5f40-4271-9365-626420fe6d30-kube-api-access-9qj24\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.890876 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.890802    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.890876 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.890824    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.891012 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.890886    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.891012 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.890944    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.991547 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.991517    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qj24\" (UniqueName: \"kubernetes.io/projected/bfa7b3db-5f40-4271-9365-626420fe6d30-kube-api-access-9qj24\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.991716 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.991551    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.991716 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.991574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.991716 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.991609    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.991905 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.991843    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.991964 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.991925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.992019 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.991992    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.992064 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.992034    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.992210 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.992193    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.993906 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.993886    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.994102 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.994074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:31.999634 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:31.999593    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qj24\" (UniqueName: \"kubernetes.io/projected/bfa7b3db-5f40-4271-9365-626420fe6d30-kube-api-access-9qj24\") pod \"rolling-upgrade-test-kserve-859df57bcb-95l7h\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:32.109162 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:32.109094    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:32.236247 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:32.236225    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"]
Jul 16 22:47:32.238543 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:47:32.238518    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa7b3db_5f40_4271_9365_626420fe6d30.slice/crio-0c6103262217ee7a13bed9540825afbb62b386a145fc1e2c145187aa280ce997 WatchSource:0}: Error finding container 0c6103262217ee7a13bed9540825afbb62b386a145fc1e2c145187aa280ce997: Status 404 returned error can't find the container with id 0c6103262217ee7a13bed9540825afbb62b386a145fc1e2c145187aa280ce997
Jul 16 22:47:33.207667 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:33.207633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h" event={"ID":"bfa7b3db-5f40-4271-9365-626420fe6d30","Type":"ContainerStarted","Data":"b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d"}
Jul 16 22:47:33.208129 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:33.207688    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h" event={"ID":"bfa7b3db-5f40-4271-9365-626420fe6d30","Type":"ContainerStarted","Data":"0c6103262217ee7a13bed9540825afbb62b386a145fc1e2c145187aa280ce997"}
Jul 16 22:47:33.227267 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:33.227216    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h" podStartSLOduration=2.227203472 podStartE2EDuration="2.227203472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:47:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:47:33.22569759 +0000 UTC m=+3452.756240317" watchObservedRunningTime="2026-07-16 22:47:33.227203472 +0000 UTC m=+3452.757746198"
Jul 16 22:47:34.109461 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:34.109426    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:42.109311 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:42.109266    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:42.121824 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:42.121796    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:42.258916 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:42.258880    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:42.488756 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:42.488718    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"]
Jul 16 22:47:42.501730 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:42.501676    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:47:42.604083 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:42.604050    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:47:43.385048 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:43.385015    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs: secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:43.385450 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:43.385095    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs podName:bfa7b3db-5f40-4271-9365-626420fe6d30 nodeName:}" failed. No retries permitted until 2026-07-16 22:47:43.885078854 +0000 UTC m=+3463.415621562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs") pod "rolling-upgrade-test-kserve-859df57bcb-95l7h" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30") : secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:43.889666 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:43.889602    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs: secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:43.889863 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:43.889714    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs podName:bfa7b3db-5f40-4271-9365-626420fe6d30 nodeName:}" failed. No retries permitted until 2026-07-16 22:47:44.889697907 +0000 UTC m=+3464.420240612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs") pod "rolling-upgrade-test-kserve-859df57bcb-95l7h" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30") : secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:44.898958 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:44.898923    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs: secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:44.899379 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:44.899016    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs podName:bfa7b3db-5f40-4271-9365-626420fe6d30 nodeName:}" failed. No retries permitted until 2026-07-16 22:47:46.898995229 +0000 UTC m=+3466.429537947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs") pod "rolling-upgrade-test-kserve-859df57bcb-95l7h" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30") : secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:46.914149 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:46.914101    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs: secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:46.914572 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:46.914193    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs podName:bfa7b3db-5f40-4271-9365-626420fe6d30 nodeName:}" failed. No retries permitted until 2026-07-16 22:47:50.914177688 +0000 UTC m=+3470.444720393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs") pod "rolling-upgrade-test-kserve-859df57bcb-95l7h" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30") : secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:50.942120 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:50.942083    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs: secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:50.942608 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:50.942171    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs podName:bfa7b3db-5f40-4271-9365-626420fe6d30 nodeName:}" failed. No retries permitted until 2026-07-16 22:47:58.942151788 +0000 UTC m=+3478.472694494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs") pod "rolling-upgrade-test-kserve-859df57bcb-95l7h" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30") : secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:59.014873 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:59.014832    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs: secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:59.015390 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:47:59.014929    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs podName:bfa7b3db-5f40-4271-9365-626420fe6d30 nodeName:}" failed. No retries permitted until 2026-07-16 22:48:15.014913025 +0000 UTC m=+3494.545455732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs") pod "rolling-upgrade-test-kserve-859df57bcb-95l7h" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30") : secret "rolling-upgrade-test-kserve-self-signed-certs" not found
Jul 16 22:47:59.277265 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.277171    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h" podUID="bfa7b3db-5f40-4271-9365-626420fe6d30" containerName="main" containerID="cri-o://b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d" gracePeriod=45
Jul 16 22:47:59.538322 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.538247    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:47:59.619706 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.619662    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-home\") pod \"bfa7b3db-5f40-4271-9365-626420fe6d30\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") "
Jul 16 22:47:59.619922 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.619735    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qj24\" (UniqueName: \"kubernetes.io/projected/bfa7b3db-5f40-4271-9365-626420fe6d30-kube-api-access-9qj24\") pod \"bfa7b3db-5f40-4271-9365-626420fe6d30\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") "
Jul 16 22:47:59.619922 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.619762    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-model-cache\") pod \"bfa7b3db-5f40-4271-9365-626420fe6d30\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") "
Jul 16 22:47:59.620049 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.619955    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-home" (OuterVolumeSpecName: "home") pod "bfa7b3db-5f40-4271-9365-626420fe6d30" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:47:59.620049 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.619984    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-tmp-dir\") pod \"bfa7b3db-5f40-4271-9365-626420fe6d30\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") "
Jul 16 22:47:59.620049 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.620033    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfa7b3db-5f40-4271-9365-626420fe6d30" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:47:59.620049 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.620043    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-dshm\") pod \"bfa7b3db-5f40-4271-9365-626420fe6d30\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") "
Jul 16 22:47:59.620252 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.620101    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs\") pod \"bfa7b3db-5f40-4271-9365-626420fe6d30\" (UID: \"bfa7b3db-5f40-4271-9365-626420fe6d30\") "
Jul 16 22:47:59.620302 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.620253    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfa7b3db-5f40-4271-9365-626420fe6d30" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:47:59.620412 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.620394    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-tmp-dir\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:47:59.620469 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.620417    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-home\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:47:59.620469 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.620431    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-model-cache\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:47:59.621936 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.621908    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa7b3db-5f40-4271-9365-626420fe6d30-kube-api-access-9qj24" (OuterVolumeSpecName: "kube-api-access-9qj24") pod "bfa7b3db-5f40-4271-9365-626420fe6d30" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30"). InnerVolumeSpecName "kube-api-access-9qj24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:47:59.622106 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.622087    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-dshm" (OuterVolumeSpecName: "dshm") pod "bfa7b3db-5f40-4271-9365-626420fe6d30" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:47:59.622167 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.622151    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfa7b3db-5f40-4271-9365-626420fe6d30" (UID: "bfa7b3db-5f40-4271-9365-626420fe6d30"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:47:59.721870 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.721816    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qj24\" (UniqueName: \"kubernetes.io/projected/bfa7b3db-5f40-4271-9365-626420fe6d30-kube-api-access-9qj24\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:47:59.721870 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.721862    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfa7b3db-5f40-4271-9365-626420fe6d30-dshm\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:47:59.721870 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:47:59.721874    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa7b3db-5f40-4271-9365-626420fe6d30-tls-certs\") on node \"ip-10-0-135-126.ec2.internal\" DevicePath \"\""
Jul 16 22:48:00.332435 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.332397    2569 generic.go:356] "Generic (PLEG): container finished" podID="bfa7b3db-5f40-4271-9365-626420fe6d30" containerID="b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d" exitCode=0
Jul 16 22:48:00.332897 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.332451    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"
Jul 16 22:48:00.332897 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.332476    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h" event={"ID":"bfa7b3db-5f40-4271-9365-626420fe6d30","Type":"ContainerDied","Data":"b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d"}
Jul 16 22:48:00.332897 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.332531    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h" event={"ID":"bfa7b3db-5f40-4271-9365-626420fe6d30","Type":"ContainerDied","Data":"0c6103262217ee7a13bed9540825afbb62b386a145fc1e2c145187aa280ce997"}
Jul 16 22:48:00.332897 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.332555    2569 scope.go:117] "RemoveContainer" containerID="b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d"
Jul 16 22:48:00.341671 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.341612    2569 scope.go:117] "RemoveContainer" containerID="b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d"
Jul 16 22:48:00.342018 ip-10-0-135-126 kubenswrapper[2569]: E0716 22:48:00.341995    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d\": container with ID starting with b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d not found: ID does not exist" containerID="b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d"
Jul 16 22:48:00.342096 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.342032    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d"} err="failed to get container status \"b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d\": rpc error: code = NotFound desc = could not find container \"b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d\": container with ID starting with b1d9ec8d3c1c6e6195aedcd400053b9433627b3e5fba44b74019ac4f5f8aca5d not found: ID does not exist"
Jul 16 22:48:00.355806 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.355769    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"]
Jul 16 22:48:00.361025 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.360991    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h"]
Jul 16 22:48:00.907452 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:00.907418    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfa7b3db-5f40-4271-9365-626420fe6d30" path="/var/lib/kubelet/pods/bfa7b3db-5f40-4271-9365-626420fe6d30/volumes"
Jul 16 22:48:06.348892 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:06.348860    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:48:06.432992 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:06.432952    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:48:06.819278 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:06.819234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:48:10.287401 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:10.287366    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:48:22.317123 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:22.317022    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:22.317518 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:22.317120    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:22.330942 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:22.330911    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:22.331185 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:22.331166    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:23.859188 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:23.859151    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:23.859641 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:23.859240    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:23.874814 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:23.874778    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:23.875053 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:23.875031    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:25.367749 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:25.367706    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:25.368224 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:25.367795    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:25.384493 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:25.384462    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:25.384828 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:25.384811    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:26.804192 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:26.804158    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:26.804590 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:26.804167    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:26.822528 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:26.822496    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:26.822833 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:26.822813    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:28.254555 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:28.254494    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:28.254993 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:28.254630    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:28.269632 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:28.269584    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:28.269848 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:28.269827    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:29.716881 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:29.716845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:29.717344 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:29.717018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:29.736920 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:29.736881    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:29.737119 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:29.736973    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:31.133664 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:31.133632    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:31.134102 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:31.133765    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:31.147188 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:31.147161    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:31.147398 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:31.147214    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:32.582392 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:32.582355    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:32.582879 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:32.582507    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:32.599637 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:32.599580    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:32.599841 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:32.599788    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:34.031658 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:34.031609    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:34.032126 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:34.031794    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:34.048991 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:34.048959    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:34.049259 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:34.049216    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:35.551193 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:35.551153    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:35.551679 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:35.551230    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:35.566877 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:35.566842    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:35.567115 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:35.567001    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:37.319786 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:37.319736    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:37.319786 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:37.319769    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:37.337105 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:37.337062    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:37.337313 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:37.337259    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:38.759640 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:38.759594    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:38.760044 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:38.759594    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:38.782037 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:38.782004    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:38.782228 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:38.782115    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:40.249790 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:40.249746    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:40.250253 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:40.249913    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:40.263831 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:40.263798    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:40.264038 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:40.263946    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:41.681111 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:41.681070    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:41.681571 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:41.681255    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:41.700409 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:41.700381    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:41.700737 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:41.700717    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:43.107938 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:43.107893    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:43.108365 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:43.108006    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:43.123467 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:43.123434    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:43.123702 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:43.123581    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:44.538329 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:44.538288    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/1.log"
Jul 16 22:48:44.538816 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:44.538376    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-gjwrm_948fe0ac-4b9b-4f1e-af78-566dc115309e/istio-proxy/0.log"
Jul 16 22:48:44.551851 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:44.551813    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/1.log"
Jul 16 22:48:44.552075 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:44.552004    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-mhvbh_b2ab4ee0-50ef-44a0-9dcd-1e3838a148d6/istio-proxy/0.log"
Jul 16 22:48:46.533701 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:46.533666    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/0.log"
Jul 16 22:48:46.568412 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:46.568378    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/1.log"
Jul 16 22:48:48.104531 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:48.104495    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/0.log"
Jul 16 22:48:48.139679 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:48.139651    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/1.log"
Jul 16 22:48:49.170762 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:49.170722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-97wxk_9b6ba87a-5fb4-4612-9a32-467129f0c6fd/manager/0.log"
Jul 16 22:48:51.888939 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:51.888897    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:48:52.051335 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:52.051297    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:48:52.149252 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:52.149158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:48:54.856603 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:54.856569    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-85jhb_d7fc421f-ea4c-45a7-a7c6-487c7fb8aceb/global-pull-secret-syncer/0.log"
Jul 16 22:48:54.982110 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:54.982073    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log"
Jul 16 22:48:55.100064 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:55.100033    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-126.ec2.internal_2e512000d9c56b71726f3bdf954e6827/haproxy/0.log"
Jul 16 22:48:58.102936 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:58.102903    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:48:58.214423 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:48:58.214386    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:49:00.106301 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:00.106257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-97wxk_9b6ba87a-5fb4-4612-9a32-467129f0c6fd/manager/0.log"
Jul 16 22:49:02.281179 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.281150    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7674b7d959-vwv5f_b9c6c23f-f129-4af4-9fce-5cd993574582/metrics-server/0.log"
Jul 16 22:49:02.316355 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.316325    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-vzb8w_e1d0ea8a-e323-46c8-82cb-20221d079dfc/monitoring-plugin/0.log"
Jul 16 22:49:02.472252 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.472221    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdrzb_29dc197d-55e1-4798-8ff5-13b4f3cbf6ae/node-exporter/0.log"
Jul 16 22:49:02.496804 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.496779    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdrzb_29dc197d-55e1-4798-8ff5-13b4f3cbf6ae/kube-rbac-proxy/0.log"
Jul 16 22:49:02.522134 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.522105    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdrzb_29dc197d-55e1-4798-8ff5-13b4f3cbf6ae/init-textfile/0.log"
Jul 16 22:49:02.662311 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.662274    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hmcn2_d92f6bd7-4915-4bd9-a35a-f419db791188/kube-rbac-proxy-main/0.log"
Jul 16 22:49:02.691233 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.691206    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hmcn2_d92f6bd7-4915-4bd9-a35a-f419db791188/kube-rbac-proxy-self/0.log"
Jul 16 22:49:02.720719 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.720695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hmcn2_d92f6bd7-4915-4bd9-a35a-f419db791188/openshift-state-metrics/0.log"
Jul 16 22:49:02.773496 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.773403    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e10cc099-53a7-44f7-8688-d9852eb6a879/prometheus/0.log"
Jul 16 22:49:02.791377 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.791349    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e10cc099-53a7-44f7-8688-d9852eb6a879/config-reloader/0.log"
Jul 16 22:49:02.816952 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.816921    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e10cc099-53a7-44f7-8688-d9852eb6a879/thanos-sidecar/0.log"
Jul 16 22:49:02.843260 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.843213    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e10cc099-53a7-44f7-8688-d9852eb6a879/kube-rbac-proxy-web/0.log"
Jul 16 22:49:02.870639 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.870591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e10cc099-53a7-44f7-8688-d9852eb6a879/kube-rbac-proxy/0.log"
Jul 16 22:49:02.894313 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.894283    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e10cc099-53a7-44f7-8688-d9852eb6a879/kube-rbac-proxy-thanos/0.log"
Jul 16 22:49:02.921324 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:02.921277    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e10cc099-53a7-44f7-8688-d9852eb6a879/init-config-reloader/0.log"
Jul 16 22:49:04.786846 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.786806    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"]
Jul 16 22:49:04.787356 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.787304    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa7b3db-5f40-4271-9365-626420fe6d30" containerName="main"
Jul 16 22:49:04.787356 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.787324    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa7b3db-5f40-4271-9365-626420fe6d30" containerName="main"
Jul 16 22:49:04.787474 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.787453    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfa7b3db-5f40-4271-9365-626420fe6d30" containerName="main"
Jul 16 22:49:04.790547 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.790522    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:04.793137 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.793106    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5v9ch\"/\"kube-root-ca.crt\""
Jul 16 22:49:04.794380 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.794352    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5v9ch\"/\"default-dockercfg-9x8pv\""
Jul 16 22:49:04.794540 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.794398    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5v9ch\"/\"openshift-service-ca.crt\""
Jul 16 22:49:04.799597 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.799564    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"]
Jul 16 22:49:04.920879 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.920835    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-sys\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:04.921075 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.920937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5mp5\" (UniqueName: \"kubernetes.io/projected/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-kube-api-access-j5mp5\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:04.921075 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.920985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-proc\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:04.921075 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.921006    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-lib-modules\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:04.921075 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:04.921031    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-podres\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022151 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022118    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5mp5\" (UniqueName: \"kubernetes.io/projected/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-kube-api-access-j5mp5\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022252 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-proc\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022252 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022232    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-proc\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022392 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022369    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-lib-modules\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022451 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-podres\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022525 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-lib-modules\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022584 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022547    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-sys\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022584 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-podres\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.022740 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.022593    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-sys\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.032126 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.032101    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5mp5\" (UniqueName: \"kubernetes.io/projected/97d1a2fb-a6a2-4455-a379-8213cf6c1efa-kube-api-access-j5mp5\") pod \"perf-node-gather-daemonset-7dxgl\" (UID: \"97d1a2fb-a6a2-4455-a379-8213cf6c1efa\") " pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.101330 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.101225    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.236654 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.236506    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"]
Jul 16 22:49:05.239837 ip-10-0-135-126 kubenswrapper[2569]: W0716 22:49:05.239805    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97d1a2fb_a6a2_4455_a379_8213cf6c1efa.slice/crio-ab52d554a67969117fe7ea155334bfef77eb15e024bd5c25c8f6c16998bffd3f WatchSource:0}: Error finding container ab52d554a67969117fe7ea155334bfef77eb15e024bd5c25c8f6c16998bffd3f: Status 404 returned error can't find the container with id ab52d554a67969117fe7ea155334bfef77eb15e024bd5c25c8f6c16998bffd3f
Jul 16 22:49:05.619479 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.619445    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl" event={"ID":"97d1a2fb-a6a2-4455-a379-8213cf6c1efa","Type":"ContainerStarted","Data":"0d8a63bbf9ed6d0b7c86da5680717ba42343a18b7d9f8af812a05608aec7b1e1"}
Jul 16 22:49:05.619686 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.619497    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl" event={"ID":"97d1a2fb-a6a2-4455-a379-8213cf6c1efa","Type":"ContainerStarted","Data":"ab52d554a67969117fe7ea155334bfef77eb15e024bd5c25c8f6c16998bffd3f"}
Jul 16 22:49:05.619686 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.619542    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:05.635313 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.635255    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl" podStartSLOduration=1.63522649 podStartE2EDuration="1.63522649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:49:05.634483407 +0000 UTC m=+3545.165026149" watchObservedRunningTime="2026-07-16 22:49:05.63522649 +0000 UTC m=+3545.165769217"
Jul 16 22:49:05.928563 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:05.928464    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fbqr7_3c3842ad-701e-4be3-8855-0f9f2e285c58/konnectivity-agent/0.log" limit=1024
Jul 16 22:49:06.959876 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:06.959837    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wp67m_44081a2c-a610-4676-bb82-c13835d378c9/dns/0.log"
Jul 16 22:49:06.984681 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:06.984652    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wp67m_44081a2c-a610-4676-bb82-c13835d378c9/kube-rbac-proxy/0.log"
Jul 16 22:49:07.058250 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:07.058219    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7ppr6_2d3d9722-1652-4888-9fca-a110e9241f0d/dns-node-resolver/0.log"
Jul 16 22:49:07.750489 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:07.750460    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqz4m_993b5a35-6803-4ee4-9bc8-2df7b42d3491/node-ca/0.log"
Jul 16 22:49:09.363628 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:09.363576    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/0.log"
Jul 16 22:49:09.400101 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:09.400068    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/1.log"
Jul 16 22:49:09.932898 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:09.932856    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-52f86_288099fc-cbd3-44b0-83ee-640f52284a86/serve-healthcheck-canary/0.log"
Jul 16 22:49:10.615379 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:10.615346    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbzg2_58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32/kube-rbac-proxy/0.log"
Jul 16 22:49:10.638545 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:10.638516    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbzg2_58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32/exporter/0.log"
Jul 16 22:49:10.661668 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:10.661634    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbzg2_58e6c7f5-4ce6-4b52-adeb-2dc2e7734a32/extractor/0.log"
Jul 16 22:49:11.633845 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:11.633814    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5v9ch/perf-node-gather-daemonset-7dxgl"
Jul 16 22:49:13.589966 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:13.589933    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5fcdcd6776-g4j7q_61c1cbb7-aff8-4110-b141-5ee3a1cb443f/manager/0.log"
Jul 16 22:49:13.619495 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:13.619459    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-m74bm_197d7cee-d752-4a0c-a7ac-097a40b79771/openshift-lws-operator/0.log"
Jul 16 22:49:15.380591 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:15.380555    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-zz9wz_9296a2ca-cfa6-4589-83b0-0eca1ddde049/manager/0.log"
Jul 16 22:49:16.729291 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:16.729251    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/0.log"
Jul 16 22:49:16.766421 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:16.766384    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/1.log"
Jul 16 22:49:18.432159 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:18.432120    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/0.log"
Jul 16 22:49:18.469851 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:18.469809    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-lcjkw_bbda7512-284e-4616-afce-15030d362dc2/istio-proxy/1.log"
Jul 16 22:49:22.268251 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:22.268215    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htsst_d4054768-5b74-4537-80b2-dd8d55c495ff/kube-multus-additional-cni-plugins/0.log"
Jul 16 22:49:22.290573 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:22.290531    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htsst_d4054768-5b74-4537-80b2-dd8d55c495ff/egress-router-binary-copy/0.log"
Jul 16 22:49:22.312426 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:22.312396    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htsst_d4054768-5b74-4537-80b2-dd8d55c495ff/cni-plugins/0.log"
Jul 16 22:49:22.334106 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:22.334070    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htsst_d4054768-5b74-4537-80b2-dd8d55c495ff/bond-cni-plugin/0.log"
Jul 16 22:49:22.359004 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:22.358978    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htsst_d4054768-5b74-4537-80b2-dd8d55c495ff/routeoverride-cni/0.log"
Jul 16 22:49:22.382000 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:22.381967    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htsst_d4054768-5b74-4537-80b2-dd8d55c495ff/whereabouts-cni-bincopy/0.log"
Jul 16 22:49:22.404773 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:22.404740    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htsst_d4054768-5b74-4537-80b2-dd8d55c495ff/whereabouts-cni/0.log"
Jul 16 22:49:22.653327 ip-10-0-135-126 kubenswrapper[2569]: I0716 22:49:22.653229    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xbrj9_87e7ab61-d7df-4a4b-87fd-dec52001131a/kube-multus/0.log"