Jul 09 18:02:25.289136 ip-10-0-131-205 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 18:02:25.289147 ip-10-0-131-205 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 18:02:25.289154 ip-10-0-131-205 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 18:02:25.289364 ip-10-0-131-205 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 18:02:35.354154 ip-10-0-131-205 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 18:02:35.354173 ip-10-0-131-205 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ba8eadc804614749a6c6b23586b046d7 --
Jul 09 18:04:37.283588 ip-10-0-131-205 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.822740    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827128    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827140    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827143    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827146    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827149    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827153    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827156    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:04:38.838232 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827158    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827162    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827165    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827167    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827170    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827173    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827176    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827179    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827181    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827184    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827186    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827189    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827192    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827196    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827199    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827206    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827209    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827212    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827214    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827217    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:04:38.838993 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827219    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827222    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827225    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827228    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827230    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827233    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827235    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827238    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827240    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827243    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827246    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827248    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827251    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827254    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827257    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827259    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827264    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827268    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827272    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:04:38.839604 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827275    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827278    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827280    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827283    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827286    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827289    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827293    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827296    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827300    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827303    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827306    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827309    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827312    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827315    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827317    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827320    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827323    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827326    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827328    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:04:38.840426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827331    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827333    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827336    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827339    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827342    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827345    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827348    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827351    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827353    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827356    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827358    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827361    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827363    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827366    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827368    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827371    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827374    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827378    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827381    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827384    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:04:38.840974 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827386    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827389    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827392    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827394    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827397    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827399    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827402    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827405    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827407    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827411    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827414    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827416    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827418    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.827421    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828148    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828155    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828159    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828162    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828164    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828168    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:04:38.995275 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828171    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:04:38.898779 ip-10-0-131-205 systemd[1]: Started Kubernetes Kubelet.
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828174    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828177    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828180    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828182    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828186    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828189    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828191    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828194    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828197    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828201    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828205    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828208    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828211    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828214    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828217    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828219    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828222    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828225    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828227    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:04:38.995958 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828230    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828233    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828235    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828238    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828241    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828244    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828247    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828249    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828252    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828255    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828257    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828260    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828263    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828265    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828268    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828271    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828273    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828276    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828278    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:04:38.996734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828283    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828286    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828289    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828292    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828294    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828297    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828300    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828302    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828305    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828307    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828309    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828312    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828314    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828317    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828319    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828322    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828325    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828328    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828332    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:04:38.997437 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828335    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828337    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828340    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828343    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828345    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828348    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828350    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828354    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828356    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828360    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828363    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828365    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828368    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828370    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828373    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828375    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828377    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828380    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828382    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828385    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:04:38.997992 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828387    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828390    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828393    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828395    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828398    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828401    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828403    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828405    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828408    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828410    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828413    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828415    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828418    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828421    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828424    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828819    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828824    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828828    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828831    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828838    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:04:38.998620 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828841    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828844    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828847    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828849    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828852    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828855    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828858    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828861    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828863    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828866    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828869    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828871    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828874    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828877    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828881    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828884    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828890    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828893    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828896    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828899    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:04:38.999261 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828901    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828904    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828907    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828909    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828912    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828914    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828917    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828919    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828922    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828924    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828927    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828929    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828950    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828953    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828956    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828959    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828961    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828966    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828970    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:04:38.999877 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828973    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828976    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828980    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828984    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828987    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828990    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828993    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828996    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.828998    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829003    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829006    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829009    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829012    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829014    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829017    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829019    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829022    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829024    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829027    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:04:39.000445 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829029    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829032    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829034    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829037    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829040    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829045    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829049    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829068    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829072    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829075    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829078    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829080    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829083    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829085    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829088    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829091    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829094    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829096    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829099    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:04:39.001028 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829101    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829104    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829106    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829111    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829113    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829116    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829118    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829121    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829123    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829126    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829128    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829131    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829133    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829136    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829138    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829141    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829143    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829204    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829212    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829219    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829224    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 18:04:39.001595 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829232    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829237    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829245    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829253    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829256    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829259    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829263    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829266    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829269    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829272    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829275    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829279    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829282    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829285    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829290    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829293    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829296    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829299    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829302    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829306    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829316    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829320    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829323    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829326    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 18:04:39.002233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829329    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829332    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829335    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829338    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829342    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829346    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829349    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829352    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829355    2569 flags.go:64] FLAG: --enable-server="true"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829360    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829373    2569 flags.go:64] FLAG: --event-burst="100"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829376    2569 flags.go:64] FLAG: --event-qps="50"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829379    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829382    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829385    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829396    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829399    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829402    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829405    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829408    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829411    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829414    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829418    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829421    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829424    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 18:04:39.002918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829427    2569 flags.go:64] FLAG: --feature-gates=""
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829431    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829433    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829437    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829440    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829442    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829445    2569 flags.go:64] FLAG: --help="false"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829448    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829451    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829454    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829457    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829460    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829465    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829467    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829470    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829473    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829476    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829479    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829482    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829485    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829488    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829491    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829493    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829496    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 18:04:39.003620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829499    2569 flags.go:64] FLAG: --lock-file=""
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829502    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829504    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829507    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829513    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829517    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829519    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829523    2569 flags.go:64] FLAG: --logging-format="text"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829525    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829529    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829532    2569 flags.go:64] FLAG: --manifest-url=""
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829534    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829538    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829541    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829545    2569 flags.go:64] FLAG: --max-pods="110"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829548    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829551    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829554    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829557    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829560    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829565    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829567    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829575    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829578    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829581    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 18:04:39.004281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829584    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829588    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829594    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829597    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829600    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829603    2569 flags.go:64] FLAG: --port="10250"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829606    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829609    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ccb06884024ebffc"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829612    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829615    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829618    2569 flags.go:64] FLAG: --register-node="true"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829620    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829626    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829629    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829632    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829634    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829638    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829641    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829644    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829647    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829650    2569 flags.go:64] FLAG: --runonce="false"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829652    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829656    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829663    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829665    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 18:04:39.004943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829668    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829672    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829675    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829679    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829682    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829685    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829688    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829691    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829694    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829698    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829700    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829706    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829709    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829712    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829715    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829718    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829721    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829723    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829726    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829730    2569 flags.go:64] FLAG: --v="2"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829734    2569 flags.go:64] FLAG: --version="false"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829738    2569 flags.go:64] FLAG: --vmodule=""
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829741    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.829744    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 18:04:39.005837 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829860    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829863    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829866    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829869    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829873    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829876    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829878    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829881    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829883    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829887    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829891    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829895    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829898    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829901    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829904    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829907    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829910    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829912    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829915    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:04:39.006926 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829918    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829921    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829923    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829925    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829928    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829930    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829933    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829935    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829940    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829943    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829945    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829948    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829951    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829953    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829956    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829958    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829961    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829963    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829966    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829968    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:04:39.007811 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829972    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829976    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829978    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829981    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829986    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829988    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829991    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829993    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829996    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.829998    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830001    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830003    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830007    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830010    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830012    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830015    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830017    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830020    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830022    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830025    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:04:39.008671 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830028    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830031    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830033    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830036    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830038    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830041    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830043    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830046    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830049    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830066    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830070    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830073    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830075    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830078    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830081    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830084    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830087    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830090    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830093    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830095    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:04:39.011828 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830098    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830100    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830103    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830105    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830108    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830111    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830114    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830116    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830119    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830121    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830124    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830126    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830130    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830133    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830135    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830138    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830140    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830143    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830146    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:04:39.012706 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.830148    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.831079    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.838163    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.838181    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.838200    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.838206    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838270    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838275    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838278    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838281    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838284    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838287    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838290    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838293    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838296    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:04:39.225942 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838299    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838301    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838304    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838307    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838310    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838312    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838315    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838318    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838320    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838323    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838326    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838329    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838331    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838335    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838338    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838341    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838343    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838346    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838349    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:04:39.248095 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838351    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838360    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838365    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838368    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838371    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838373    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838376    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838380    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838384    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838387    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838390    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838393    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838396    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838399    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838401    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838404    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838407    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838410    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838413    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:04:39.248766 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838416    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838419    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838421    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838424    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838426    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838429    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838431    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838436    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838439    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838442    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838445    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838448    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838451    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838454    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838457    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838470    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838473    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838475    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838478    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:04:39.249386 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838480    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838483    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838485    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838488    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838491    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838493    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838496    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838498    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838501    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838503    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838506    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838508    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838511    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838514    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838516    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838519    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838521    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838524    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838526    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838529    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:04:39.250282 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838533    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838536    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838539    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838542    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838545    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838547    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838550    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838552    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838556    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838565    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838568    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838573    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838576    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.838581    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838726    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:04:39.251172 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838731    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838734    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838737    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838740    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838743    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838746    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838749    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838752    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838755    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838757    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838760    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838763    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838765    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838768    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838771    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838773    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838776    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838779    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838781    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838785    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:04:39.251824 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838789    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838792    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838795    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838797    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838800    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838804    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838807    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838815    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838818    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838822    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838825    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838827    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838831    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838834    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838837    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838840    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838842    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838845    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838848    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:04:39.252888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838856    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838859    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838861    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838864    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838867    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838869    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838872    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838874    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838877    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838879    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838882    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838884    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838887    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838889    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838892    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838894    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838896    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838899    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838903    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838905    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:04:39.253767 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838908    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838917    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838921    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838924    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838926    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838929    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838931    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838934    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838936    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838939    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838942    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838944    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838947    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838950    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838952    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838955    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838958    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838960    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838962    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:04:39.254642 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838965    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838967    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838970    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838972    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838975    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838977    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838980    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838982    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838985    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838989    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838991    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838995    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.838997    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.839000    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.839003    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.839012    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.839014    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.839018    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.839020    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:04:39.255498 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:38.839023    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.839027    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.839169    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.842025    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.843563    2569 server.go:1019] "Starting client certificate rotation"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.843661    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.843689    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.848351    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.852932    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.863482    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.865515    2569 log.go:25] "Validated CRI v1 image API"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.867087    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 18:04:39.256569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.869681    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 824dc040-e58b-431c-8037-c405acf3a391:/dev/nvme0n1p3 aa699b6e-5c5e-4950-b99b-cc4d13f045f6:/dev/nvme0n1p4]
Jul 09 18:04:39.257426 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.869704    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 18:04:39.257634 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.875664    2569 manager.go:216] Machine: {Timestamp:2026-07-09 18:04:38.874308152 +0000 UTC m=+0.373364890 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102026 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d1530ef52b729700b2abbfc6bcd4 SystemUUID:ec22d153-0ef5-2b72-9700-b2abbfc6bcd4 BootID:ba8eadc8-0461-4749-a6c6-b23586b046d7 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ac:d8:d6:95:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ac:d8:d6:95:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:5d:d0:4e:b5:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 18:04:39.257634 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.875766    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 18:04:39.257634 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.875876    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 18:04:39.257634 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.878863    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 18:04:39.257634 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.878891    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 18:04:39.257634 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.879458    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:04:39.257634 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.879561    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.879574    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.879582    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.880092    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.881304    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884172    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884291    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884319    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884329    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884340    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884350    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884359    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884670    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.884684    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.887813    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892109    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892145    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892350    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892364    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892377    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892383    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892397    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892404    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892953    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892960    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892968    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892974    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892983    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.892991    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.893758    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.893815    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.897586    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.897586    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.897721    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.897994    2569 server.go:1268] "Started kubelet"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.898078    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.898088    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.898153    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.899577    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.901926    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 18:04:39.258085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.903668    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kpt52"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.903579    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-205.ec2.internal.18c0b13191e56f4f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-205.ec2.internal,UID:ip-10-0-131-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-205.ec2.internal,},FirstTimestamp:2026-07-09 18:04:38.897962831 +0000 UTC m=+0.397019569,LastTimestamp:2026-07-09 18:04:38.897962831 +0000 UTC m=+0.397019569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-205.ec2.internal,}"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.905189    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.907088    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.907159    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.907273    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.907704    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.907716    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.907735    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.907838    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.907848    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.908049    2569 factory.go:55] Registering systemd factory
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.908079    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.908273    2569 factory.go:153] Registering CRI-O factory
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.908287    2569 factory.go:223] Registration of the crio container factory successfully
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.908347    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.908376    2569 factory.go:103] Registering Raw factory
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.908391    2569 manager.go:1196] Started watching for new ooms in manager
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.908840    2569 manager.go:349] Starting recovery of all containers
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.913739    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kpt52"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.915167    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.915281    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.922238    2569 manager.go:354] Recovery completed
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.933040    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.934915    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.934944    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.934955    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.935512    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.935524    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.935540    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.935544    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.936208    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:04:39.259797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.936231    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.936240    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.936673    2569 policy_none.go:49] "None policy: Start"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.936686    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.936696    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.937813    2569 policy_none.go:47] "Start"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.984613    2569 manager.go:337] "Starting Device Plugin manager"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.984779    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.984790    2569 server.go:87] "Starting device plugin registration server"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.985002    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.985011    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.985209    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.985306    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:38.985324    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.985715    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:38.985765    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.085264    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.086155    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.086180    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.086190    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.086215    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.094916    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.094935    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-205.ec2.internal\": node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.114135    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.115383    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.115412    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.115439    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.115476    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.115808    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.118884    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.215530    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal"]
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.215607    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.215983    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.216593    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.216619    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.216630    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.218240    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.218356    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.261296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.218384    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.218963    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.218984    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.218994    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.218963    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.219075    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.219091    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.220525    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.220547    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.221253    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.221282    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.221293    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.242557    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-205.ec2.internal\" not found" node="ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.263015 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.246551    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-205.ec2.internal\" not found" node="ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.311510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/971cacb371a35a47b8e39af3fe63cd43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal\" (UID: \"971cacb371a35a47b8e39af3fe63cd43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.311534    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/971cacb371a35a47b8e39af3fe63cd43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal\" (UID: \"971cacb371a35a47b8e39af3fe63cd43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.311551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bc21c147e1940ae7b527f63edb824e1-config\") pod \"kube-apiserver-proxy-ip-10-0-131-205.ec2.internal\" (UID: \"7bc21c147e1940ae7b527f63edb824e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.316677    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.412547    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bc21c147e1940ae7b527f63edb824e1-config\") pod \"kube-apiserver-proxy-ip-10-0-131-205.ec2.internal\" (UID: \"7bc21c147e1940ae7b527f63edb824e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.412582    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/971cacb371a35a47b8e39af3fe63cd43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal\" (UID: \"971cacb371a35a47b8e39af3fe63cd43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.412606    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/971cacb371a35a47b8e39af3fe63cd43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal\" (UID: \"971cacb371a35a47b8e39af3fe63cd43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.412636    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/971cacb371a35a47b8e39af3fe63cd43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal\" (UID: \"971cacb371a35a47b8e39af3fe63cd43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.412645    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bc21c147e1940ae7b527f63edb824e1-config\") pod \"kube-apiserver-proxy-ip-10-0-131-205.ec2.internal\" (UID: \"7bc21c147e1940ae7b527f63edb824e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.412681    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/971cacb371a35a47b8e39af3fe63cd43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal\" (UID: \"971cacb371a35a47b8e39af3fe63cd43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.464701 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.417642    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.678724 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.518115    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.678724 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.545265    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.678724 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.549272    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:39.678724 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.618419    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.866474 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.718976    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.866474 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.819467    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:39.866474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.842611    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 18:04:39.866474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.842774    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.917372    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 17:59:38 +0000 UTC" deadline="2028-02-16 05:18:21.194584997 +0000 UTC"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.917396    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14075h13m41.277191819s"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:39.920507    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-205.ec2.internal\" not found"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.924627    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:39.949028    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.007479    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.019785    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.022881    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal"
Jul 09 18:04:40.070942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.031516    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:04:40.236681 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.122573    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:04:40.236681 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:40.175200    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971cacb371a35a47b8e39af3fe63cd43.slice/crio-0cd33c1ae6babeb6473558600b627f119efa31f3a3cc9078e9332bd6207adabf WatchSource:0}: Error finding container 0cd33c1ae6babeb6473558600b627f119efa31f3a3cc9078e9332bd6207adabf: Status 404 returned error can't find the container with id 0cd33c1ae6babeb6473558600b627f119efa31f3a3cc9078e9332bd6207adabf
Jul 09 18:04:40.236681 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:40.175747    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc21c147e1940ae7b527f63edb824e1.slice/crio-03f55e192200f8ea305111c3c42e08a41ad7b2bdb54c7e39d8394359273ae3c4 WatchSource:0}: Error finding container 03f55e192200f8ea305111c3c42e08a41ad7b2bdb54c7e39d8394359273ae3c4: Status 404 returned error can't find the container with id 03f55e192200f8ea305111c3c42e08a41ad7b2bdb54c7e39d8394359273ae3c4
Jul 09 18:04:40.236681 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.183869    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:04:40.810159 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.757044    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:04:40.886249 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.885612    2569 apiserver.go:52] "Watching apiserver"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.897033    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.899223    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pszsp","kube-system/konnectivity-agent-cwk5m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85","openshift-cluster-node-tuning-operator/tuned-p867f","openshift-image-registry/node-ca-mx7g4","openshift-multus/multus-additional-cni-plugins-4vs42","openshift-network-diagnostics/network-check-target-jr4r4","kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal","openshift-dns/node-resolver-52r8t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal","openshift-multus/multus-5n5wn","openshift-multus/network-metrics-daemon-msmqp","openshift-network-operator/iptables-alerter-twt8f","openshift-ovn-kubernetes/ovnkube-node-mhbzn"]
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.900857    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:40.900922    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.902224    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.903377    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.904615    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.906590    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.907621    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.907934    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.908568    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.908993    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.909020    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.909026    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.909290    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.909516    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.909545    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j5g4d\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.909607    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.910012    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.910464    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.911296    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.911349    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:40.911361    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.912662    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:04:40.963687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.913143    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k4bhf\""
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.913822    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qwp2m\""
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.913864    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.913873    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.913905    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pjxsz\""
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.914008    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.914051    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.914278    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.915591    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.917504    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:40.917605    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919001    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919004    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-iptables-alerter-script\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxs4f\" (UniqueName: \"kubernetes.io/projected/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-kube-api-access-zxs4f\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919095    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2c30535-1255-4b1f-9e87-5c146bfd3088-hosts-file\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919172    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c30535-1255-4b1f-9e87-5c146bfd3088-tmp-dir\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919199    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-os-release\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.965643 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysctl-d\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysctl-conf\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919297    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-registration-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-cnibin\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-systemd\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919382    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-run\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mw45\" (UniqueName: \"kubernetes.io/projected/d2c30535-1255-4b1f-9e87-5c146bfd3088-kube-api-access-2mw45\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919459    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-sys-fs\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919513    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-system-cni-dir\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-host\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919575    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-host-slash\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919592    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-socket-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-device-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:40.967752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919664    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d159c5e-5891-4508-93bc-dad49b37d682-etc-tuned\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919701    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d159c5e-5891-4508-93bc-dad49b37d682-tmp\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-serviceca\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8mvt\" (UniqueName: \"kubernetes.io/projected/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-kube-api-access-c8mvt\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919787    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-etc-selinux\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjh6\" (UniqueName: \"kubernetes.io/projected/5006d8f7-d558-4269-9f13-02400e8a008f-kube-api-access-tzjh6\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysconfig\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919930    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-sys\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-lib-modules\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919974    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-var-lib-kubelet\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.919996    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.920022    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5ntg\" (UniqueName: \"kubernetes.io/projected/722305f7-f162-451c-809a-301a9fc7b0b4-kube-api-access-r5ntg\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.920043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-modprobe-d\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.920095    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-kubernetes\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.920115    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvxc4\" (UniqueName: \"kubernetes.io/projected/2d159c5e-5891-4508-93bc-dad49b37d682-kube-api-access-hvxc4\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.920142    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-host\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.920864    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.921144    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.928653    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.929273    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2tx24\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.929333    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.929615    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q27q5\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.929643    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.929657    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.929939    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.929954    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.929966    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.930228    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cq5v2\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.930310    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zhvng\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.930519    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8hzgk\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.930750    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.931084    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.931138    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.931140    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 18:04:40.968945 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:40.948325    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:04:41.009208 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.009137    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 18:04:41.020592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-registration-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.020592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-cnibin\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.020755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-systemd\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.020755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-run\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.020755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020646    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mw45\" (UniqueName: \"kubernetes.io/projected/d2c30535-1255-4b1f-9e87-5c146bfd3088-kube-api-access-2mw45\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:41.020755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020673    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-kubelet\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.020755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020696    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-multus-certs\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.020755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-system-cni-dir\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.020755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020743    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-host\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020764    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-host-slash\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.020812    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8mvt\" (UniqueName: \"kubernetes.io/projected/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-kube-api-access-c8mvt\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021025    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021081    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-cni-netd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovnkube-config\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021155    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021196    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-etc-selinux\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.021217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021215    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-registration-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021222    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-slash\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-netns\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021288    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-system-cni-dir\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021319    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-cni-bin\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysconfig\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021355    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-host\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-lib-modules\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021397    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-host-slash\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021398    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021433    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5ntg\" (UniqueName: \"kubernetes.io/projected/722305f7-f162-451c-809a-301a9fc7b0b4-kube-api-access-r5ntg\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021449    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-cnibin\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021460    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-modprobe-d\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.021710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021503    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-systemd\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021532    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-kubernetes\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-host\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021565    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-modprobe-d\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021564    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-env-overrides\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-node-log\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-log-socket\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021657    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-etc-selinux\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-iptables-alerter-script\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021707    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-run\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021708    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxs4f\" (UniqueName: \"kubernetes.io/projected/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-kube-api-access-zxs4f\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021780    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-kubernetes\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021780    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-host\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021843    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysconfig\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.022456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021889    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2c30535-1255-4b1f-9e87-5c146bfd3088-hosts-file\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021890    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-lib-modules\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c30535-1255-4b1f-9e87-5c146bfd3088-tmp-dir\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.021964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-var-lib-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv8cd\" (UniqueName: \"kubernetes.io/projected/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-kube-api-access-rv8cd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022030    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-os-release\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022038    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2c30535-1255-4b1f-9e87-5c146bfd3088-hosts-file\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-run-netns\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-cnibin\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022156    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-os-release\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022168    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-os-release\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022180    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5d4b889-895b-4c71-a943-85aae52800fe-cni-binary-copy\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022108    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/722305f7-f162-451c-809a-301a9fc7b0b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.023193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-socket-dir-parent\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022388    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c30535-1255-4b1f-9e87-5c146bfd3088-tmp-dir\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-kubelet\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-hostroot\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022464    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c5d4b889-895b-4c71-a943-85aae52800fe-multus-daemon-config\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022487    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-iptables-alerter-script\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022514    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-sys-fs\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a-agent-certs\") pod \"konnectivity-agent-cwk5m\" (UID: \"8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a\") " pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-sys-fs\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022573    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-etc-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022598    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-k8s-cni-cncf-io\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-conf-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022645    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-dbus\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-socket-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.023915 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-device-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d159c5e-5891-4508-93bc-dad49b37d682-etc-tuned\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022775    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-socket-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d159c5e-5891-4508-93bc-dad49b37d682-tmp\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022815    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5006d8f7-d558-4269-9f13-02400e8a008f-device-dir\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-serviceca\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022898    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-cni-bin\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovn-node-metrics-cert\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.022984    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-ovn\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023021    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjh6\" (UniqueName: \"kubernetes.io/projected/5006d8f7-d558-4269-9f13-02400e8a008f-kube-api-access-tzjh6\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023027    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023045    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-sys\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023086    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-var-lib-kubelet\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.024566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-system-cni-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-cni-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023153    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-etc-kubernetes\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvxc4\" (UniqueName: \"kubernetes.io/projected/2d159c5e-5891-4508-93bc-dad49b37d682-kube-api-access-hvxc4\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a-konnectivity-ca\") pod \"konnectivity-agent-cwk5m\" (UID: \"8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a\") " pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023245    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-serviceca\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023255    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovnkube-script-lib\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lsk\" (UniqueName: \"kubernetes.io/projected/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-kube-api-access-82lsk\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-systemd-units\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-systemd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023516    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-sys\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-var-lib-kubelet\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.025252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023589    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzpmv\" (UniqueName: \"kubernetes.io/projected/c5d4b889-895b-4c71-a943-85aae52800fe-kube-api-access-nzpmv\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023621    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-kubelet-config\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysctl-d\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysctl-conf\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-cni-multus\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023749    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023904    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.023920    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysctl-conf\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.024015    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d159c5e-5891-4508-93bc-dad49b37d682-etc-sysctl-d\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.025985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.024321    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/722305f7-f162-451c-809a-301a9fc7b0b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.026543 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.026248    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrfsm"
Jul 09 18:04:41.027094 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.027026    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d159c5e-5891-4508-93bc-dad49b37d682-tmp\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.027712 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.027693    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d159c5e-5891-4508-93bc-dad49b37d682-etc-tuned\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.040539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.040504    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrfsm"
Jul 09 18:04:41.057032 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.057011    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:04:41.057155 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.057042    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:04:41.057155 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.057069    2569 projected.go:196] Error preparing data for projected volume kube-api-access-c7qgf for pod openshift-network-diagnostics/network-check-target-jr4r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:41.057155 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.057146    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf podName:e74513ee-2955-47cf-9ae4-5f4f7b911bde nodeName:}" failed. No retries permitted until 2026-07-09 18:04:41.557125331 +0000 UTC m=+3.056182080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c7qgf" (UniqueName: "kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf") pod "network-check-target-jr4r4" (UID: "e74513ee-2955-47cf-9ae4-5f4f7b911bde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:41.065775 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.065680    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mw45\" (UniqueName: \"kubernetes.io/projected/d2c30535-1255-4b1f-9e87-5c146bfd3088-kube-api-access-2mw45\") pod \"node-resolver-52r8t\" (UID: \"d2c30535-1255-4b1f-9e87-5c146bfd3088\") " pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:41.069208 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.069165    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvxc4\" (UniqueName: \"kubernetes.io/projected/2d159c5e-5891-4508-93bc-dad49b37d682-kube-api-access-hvxc4\") pod \"tuned-p867f\" (UID: \"2d159c5e-5891-4508-93bc-dad49b37d682\") " pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.072492 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.072441    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5ntg\" (UniqueName: \"kubernetes.io/projected/722305f7-f162-451c-809a-301a9fc7b0b4-kube-api-access-r5ntg\") pod \"multus-additional-cni-plugins-4vs42\" (UID: \"722305f7-f162-451c-809a-301a9fc7b0b4\") " pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.090666 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.090614    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8mvt\" (UniqueName: \"kubernetes.io/projected/e3f6f546-6c19-4bd6-89f6-5b049cad7bde-kube-api-access-c8mvt\") pod \"node-ca-mx7g4\" (UID: \"e3f6f546-6c19-4bd6-89f6-5b049cad7bde\") " pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:41.092070 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.092032    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjh6\" (UniqueName: \"kubernetes.io/projected/5006d8f7-d558-4269-9f13-02400e8a008f-kube-api-access-tzjh6\") pod \"aws-ebs-csi-driver-node-f8z85\" (UID: \"5006d8f7-d558-4269-9f13-02400e8a008f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.106024 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.105976    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxs4f\" (UniqueName: \"kubernetes.io/projected/dc24bbc8-0261-40dc-8ffe-b7ce7c209c60-kube-api-access-zxs4f\") pod \"iptables-alerter-twt8f\" (UID: \"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60\") " pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:41.121532 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.121427    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal" event={"ID":"7bc21c147e1940ae7b527f63edb824e1","Type":"ContainerStarted","Data":"03f55e192200f8ea305111c3c42e08a41ad7b2bdb54c7e39d8394359273ae3c4"}
Jul 09 18:04:41.123014 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.122989    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal" event={"ID":"971cacb371a35a47b8e39af3fe63cd43","Type":"ContainerStarted","Data":"0cd33c1ae6babeb6473558600b627f119efa31f3a3cc9078e9332bd6207adabf"}
Jul 09 18:04:41.124420 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124401    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-systemd-units\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.124525 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124432    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-systemd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.124525 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124457    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzpmv\" (UniqueName: \"kubernetes.io/projected/c5d4b889-895b-4c71-a943-85aae52800fe-kube-api-access-nzpmv\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.124525 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:41.124525 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124505    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-kubelet-config\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.124740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-cni-multus\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.124740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.124740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124597    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-kubelet\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.124740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124623    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-multus-certs\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.124740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.124740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-cni-netd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.124740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124698    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovnkube-config\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.124740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124723    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-slash\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.124750    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124759    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124776    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-systemd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124526    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-systemd-units\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124788    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-netns\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.124817    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs podName:bcf7e722-8a18-4a9c-9a03-b8033505fc4e nodeName:}" failed. No retries permitted until 2026-07-09 18:04:41.624798562 +0000 UTC m=+3.123855292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs") pod "network-metrics-daemon-msmqp" (UID: "bcf7e722-8a18-4a9c-9a03-b8033505fc4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124828    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-multus-certs\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124840    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-netns\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124851    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124869    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-kubelet-config\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124880    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-cni-netd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124887    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-kubelet\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124915    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-cni-multus\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.125134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124929    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-slash\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.124969    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.125043    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.125137    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret podName:d8ab92ab-b3bb-4440-a0a2-39c193c64a15 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:41.625116382 +0000 UTC m=+3.124173108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret") pod "global-pull-secret-syncer-pszsp" (UID: "d8ab92ab-b3bb-4440-a0a2-39c193c64a15") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-cni-bin\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125188    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-env-overrides\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-node-log\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125271    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-cni-bin\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125265    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-log-socket\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125320    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-log-socket\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-var-lib-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125362    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125399    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-var-lib-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.125772 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125399    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-node-log\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv8cd\" (UniqueName: \"kubernetes.io/projected/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-kube-api-access-rv8cd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-run-netns\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-cnibin\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-os-release\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5d4b889-895b-4c71-a943-85aae52800fe-cni-binary-copy\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-socket-dir-parent\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125573    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-kubelet\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-hostroot\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c5d4b889-895b-4c71-a943-85aae52800fe-multus-daemon-config\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a-agent-certs\") pod \"konnectivity-agent-cwk5m\" (UID: \"8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a\") " pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-etc-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125685    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-env-overrides\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-k8s-cni-cncf-io\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-run-k8s-cni-cncf-io\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.126518 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125741    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-conf-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125765    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-dbus\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125771    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-socket-dir-parent\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-cni-bin\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125807    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-host-var-lib-kubelet\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovn-node-metrics-cert\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125842    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-hostroot\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-ovn\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125890    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-system-cni-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-cni-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-etc-kubernetes\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125952    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-dbus\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125966    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a-konnectivity-ca\") pod \"konnectivity-agent-cwk5m\" (UID: \"8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a\") " pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovnkube-script-lib\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126033    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-system-cni-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126042    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82lsk\" (UniqueName: \"kubernetes.io/projected/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-kube-api-access-82lsk\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126107    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-cni-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126169    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5d4b889-895b-4c71-a943-85aae52800fe-cni-binary-copy\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126229    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-run-netns\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126280    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-cnibin\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126327    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c5d4b889-895b-4c71-a943-85aae52800fe-multus-daemon-config\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126345    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-os-release\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126348    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-host-cni-bin\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.125822    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-multus-conf-dir\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126390    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5d4b889-895b-4c71-a943-85aae52800fe-etc-kubernetes\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126402    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-etc-openvswitch\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126485    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-run-ovn\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126610    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a-konnectivity-ca\") pod \"konnectivity-agent-cwk5m\" (UID: \"8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a\") " pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126681    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovnkube-config\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.127856 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.126958    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovnkube-script-lib\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.128663 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.128640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-ovn-node-metrics-cert\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.129487 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.129341    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a-agent-certs\") pod \"konnectivity-agent-cwk5m\" (UID: \"8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a\") " pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:04:41.146554 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.146526    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzpmv\" (UniqueName: \"kubernetes.io/projected/c5d4b889-895b-4c71-a943-85aae52800fe-kube-api-access-nzpmv\") pod \"multus-5n5wn\" (UID: \"c5d4b889-895b-4c71-a943-85aae52800fe\") " pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.158704 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.158513    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lsk\" (UniqueName: \"kubernetes.io/projected/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-kube-api-access-82lsk\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:41.172245 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.172222    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv8cd\" (UniqueName: \"kubernetes.io/projected/6572fa80-150a-46a3-b8e6-cf50e2ad9d13-kube-api-access-rv8cd\") pod \"ovnkube-node-mhbzn\" (UID: \"6572fa80-150a-46a3-b8e6-cf50e2ad9d13\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.218443 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.218288    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twt8f"
Jul 09 18:04:41.227474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.227440    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85"
Jul 09 18:04:41.240692 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.240634    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p867f"
Jul 09 18:04:41.243603 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.243577    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mx7g4"
Jul 09 18:04:41.251523 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.251500    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4vs42"
Jul 09 18:04:41.260804 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.260781    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52r8t"
Jul 09 18:04:41.268436 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.268414    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:04:41.277890 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.277725    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:04:41.285446 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.285423    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5n5wn"
Jul 09 18:04:41.629844 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.629807    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:41.630036 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.629862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:41.630036 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:41.629895    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:41.630036 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.629948    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:04:41.630036 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.629968    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:04:41.630036 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.629980    2569 projected.go:196] Error preparing data for projected volume kube-api-access-c7qgf for pod openshift-network-diagnostics/network-check-target-jr4r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:41.630036 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.630004    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:41.630308 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.630032    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:41.630308 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.630036    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf podName:e74513ee-2955-47cf-9ae4-5f4f7b911bde nodeName:}" failed. No retries permitted until 2026-07-09 18:04:42.630018581 +0000 UTC m=+4.129075323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7qgf" (UniqueName: "kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf") pod "network-check-target-jr4r4" (UID: "e74513ee-2955-47cf-9ae4-5f4f7b911bde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:41.630308 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.630128    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret podName:d8ab92ab-b3bb-4440-a0a2-39c193c64a15 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:42.630114768 +0000 UTC m=+4.129171500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret") pod "global-pull-secret-syncer-pszsp" (UID: "d8ab92ab-b3bb-4440-a0a2-39c193c64a15") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:41.630308 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:41.630146    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs podName:bcf7e722-8a18-4a9c-9a03-b8033505fc4e nodeName:}" failed. No retries permitted until 2026-07-09 18:04:42.630134601 +0000 UTC m=+4.129191329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs") pod "network-metrics-daemon-msmqp" (UID: "bcf7e722-8a18-4a9c-9a03-b8033505fc4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:42.044308 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:42.044221    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:59:41 +0000 UTC" deadline="2028-03-05 04:33:01.827492798 +0000 UTC"
Jul 09 18:04:42.044308 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:42.044261    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14506h28m19.78323562s"
Jul 09 18:04:42.201557 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.201524    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f6f546_6c19_4bd6_89f6_5b049cad7bde.slice/crio-f92e480ca41a4e8b2da18620e55766919a7f73ccd2101ffa6c64e583bc5335eb WatchSource:0}: Error finding container f92e480ca41a4e8b2da18620e55766919a7f73ccd2101ffa6c64e583bc5335eb: Status 404 returned error can't find the container with id f92e480ca41a4e8b2da18620e55766919a7f73ccd2101ffa6c64e583bc5335eb
Jul 09 18:04:42.223182 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.222992    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722305f7_f162_451c_809a_301a9fc7b0b4.slice/crio-2cdd0e645e1b2a72a9c181d4c1728c211ca2b0a0f3c67fca8d8682ce63fec903 WatchSource:0}: Error finding container 2cdd0e645e1b2a72a9c181d4c1728c211ca2b0a0f3c67fca8d8682ce63fec903: Status 404 returned error can't find the container with id 2cdd0e645e1b2a72a9c181d4c1728c211ca2b0a0f3c67fca8d8682ce63fec903
Jul 09 18:04:42.230743 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.230694    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc24bbc8_0261_40dc_8ffe_b7ce7c209c60.slice/crio-2e95be02d44ef3c35f88e00e51b08ace102dc1ba86bf879dba8cb6d8291c4ff9 WatchSource:0}: Error finding container 2e95be02d44ef3c35f88e00e51b08ace102dc1ba86bf879dba8cb6d8291c4ff9: Status 404 returned error can't find the container with id 2e95be02d44ef3c35f88e00e51b08ace102dc1ba86bf879dba8cb6d8291c4ff9
Jul 09 18:04:42.231764 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.231736    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d4b889_895b_4c71_a943_85aae52800fe.slice/crio-c2e3985f0540305905d4b2f5ea7bdbd3aa91c3d2b0087e2237ca6ea2678c8e31 WatchSource:0}: Error finding container c2e3985f0540305905d4b2f5ea7bdbd3aa91c3d2b0087e2237ca6ea2678c8e31: Status 404 returned error can't find the container with id c2e3985f0540305905d4b2f5ea7bdbd3aa91c3d2b0087e2237ca6ea2678c8e31
Jul 09 18:04:42.232527 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.232484    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6572fa80_150a_46a3_b8e6_cf50e2ad9d13.slice/crio-95a637e0838d9476d7d5851099ec73c0001f8b703befbd63c5fb2eb502022342 WatchSource:0}: Error finding container 95a637e0838d9476d7d5851099ec73c0001f8b703befbd63c5fb2eb502022342: Status 404 returned error can't find the container with id 95a637e0838d9476d7d5851099ec73c0001f8b703befbd63c5fb2eb502022342
Jul 09 18:04:42.234600 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.234572    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5006d8f7_d558_4269_9f13_02400e8a008f.slice/crio-69d85cd95f2b5db84cbf5c6f975853a54752aa7e7adf3fc4da035cfd2c76096c WatchSource:0}: Error finding container 69d85cd95f2b5db84cbf5c6f975853a54752aa7e7adf3fc4da035cfd2c76096c: Status 404 returned error can't find the container with id 69d85cd95f2b5db84cbf5c6f975853a54752aa7e7adf3fc4da035cfd2c76096c
Jul 09 18:04:42.236002 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.235980    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c30535_1255_4b1f_9e87_5c146bfd3088.slice/crio-da20951ab6005c63a539ff0801121d8fc0815f07a9b397510d38235278e5e586 WatchSource:0}: Error finding container da20951ab6005c63a539ff0801121d8fc0815f07a9b397510d38235278e5e586: Status 404 returned error can't find the container with id da20951ab6005c63a539ff0801121d8fc0815f07a9b397510d38235278e5e586
Jul 09 18:04:42.236883 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.236856    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d159c5e_5891_4508_93bc_dad49b37d682.slice/crio-2db831080b2539de7eb4394c9fd8f5f5a32aa33511ab710843d55a441a58adff WatchSource:0}: Error finding container 2db831080b2539de7eb4394c9fd8f5f5a32aa33511ab710843d55a441a58adff: Status 404 returned error can't find the container with id 2db831080b2539de7eb4394c9fd8f5f5a32aa33511ab710843d55a441a58adff
Jul 09 18:04:42.238201 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:04:42.238167    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbbf4c1_03c9_4f5c_9fd3_cbe556ab686a.slice/crio-31ff62c02063d6ec6e43d0b01eaa1709c10342362c4127b33cce06c0cbcc4c44 WatchSource:0}: Error finding container 31ff62c02063d6ec6e43d0b01eaa1709c10342362c4127b33cce06c0cbcc4c44: Status 404 returned error can't find the container with id 31ff62c02063d6ec6e43d0b01eaa1709c10342362c4127b33cce06c0cbcc4c44
Jul 09 18:04:42.636851 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:42.636566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:42.637049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:42.636904    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:42.637049 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:42.636768    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:04:42.637049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:42.636940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:42.637049 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:42.636948    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:04:42.637049 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:42.636964    2569 projected.go:196] Error preparing data for projected volume kube-api-access-c7qgf for pod openshift-network-diagnostics/network-check-target-jr4r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:42.637049 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:42.637024    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:42.637049 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:42.637046    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf podName:e74513ee-2955-47cf-9ae4-5f4f7b911bde nodeName:}" failed. No retries permitted until 2026-07-09 18:04:44.637025767 +0000 UTC m=+6.136082513 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7qgf" (UniqueName: "kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf") pod "network-check-target-jr4r4" (UID: "e74513ee-2955-47cf-9ae4-5f4f7b911bde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:42.637402 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:42.637083    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:42.637402 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:42.637098    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs podName:bcf7e722-8a18-4a9c-9a03-b8033505fc4e nodeName:}" failed. No retries permitted until 2026-07-09 18:04:44.637086781 +0000 UTC m=+6.136143511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs") pod "network-metrics-daemon-msmqp" (UID: "bcf7e722-8a18-4a9c-9a03-b8033505fc4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:42.637402 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:42.637134    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret podName:d8ab92ab-b3bb-4440-a0a2-39c193c64a15 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:44.637119507 +0000 UTC m=+6.136176238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret") pod "global-pull-secret-syncer-pszsp" (UID: "d8ab92ab-b3bb-4440-a0a2-39c193c64a15") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:43.044997 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.044895    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:59:41 +0000 UTC" deadline="2028-04-14 04:21:56.787206778 +0000 UTC"
Jul 09 18:04:43.044997 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.044961    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15466h17m13.742252802s"
Jul 09 18:04:43.117229 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.117187    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:43.117408 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.117240    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:43.117408 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:43.117356    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:43.117831 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:43.117798    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:43.117942 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.117885    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:43.118003 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:43.117962    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:43.136402 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.136363    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twt8f" event={"ID":"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60","Type":"ContainerStarted","Data":"2e95be02d44ef3c35f88e00e51b08ace102dc1ba86bf879dba8cb6d8291c4ff9"}
Jul 09 18:04:43.146580 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.146542    2569 generic.go:356] "Generic (PLEG): container finished" podID="971cacb371a35a47b8e39af3fe63cd43" containerID="d593b22ebe76525b490c838333be5dd996491b252fce7d9d3528d9ba30330052" exitCode=0
Jul 09 18:04:43.146765 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.146644    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal" event={"ID":"971cacb371a35a47b8e39af3fe63cd43","Type":"ContainerDied","Data":"d593b22ebe76525b490c838333be5dd996491b252fce7d9d3528d9ba30330052"}
Jul 09 18:04:43.153800 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.153381    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwk5m" event={"ID":"8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a","Type":"ContainerStarted","Data":"31ff62c02063d6ec6e43d0b01eaa1709c10342362c4127b33cce06c0cbcc4c44"}
Jul 09 18:04:43.160863 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.160813    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p867f" event={"ID":"2d159c5e-5891-4508-93bc-dad49b37d682","Type":"ContainerStarted","Data":"2db831080b2539de7eb4394c9fd8f5f5a32aa33511ab710843d55a441a58adff"}
Jul 09 18:04:43.170909 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.170862    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5n5wn" event={"ID":"c5d4b889-895b-4c71-a943-85aae52800fe","Type":"ContainerStarted","Data":"c2e3985f0540305905d4b2f5ea7bdbd3aa91c3d2b0087e2237ca6ea2678c8e31"}
Jul 09 18:04:43.173666 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.173625    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4vs42" event={"ID":"722305f7-f162-451c-809a-301a9fc7b0b4","Type":"ContainerStarted","Data":"2cdd0e645e1b2a72a9c181d4c1728c211ca2b0a0f3c67fca8d8682ce63fec903"}
Jul 09 18:04:43.184776 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.184630    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mx7g4" event={"ID":"e3f6f546-6c19-4bd6-89f6-5b049cad7bde","Type":"ContainerStarted","Data":"f92e480ca41a4e8b2da18620e55766919a7f73ccd2101ffa6c64e583bc5335eb"}
Jul 09 18:04:43.193152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.192156    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal" event={"ID":"7bc21c147e1940ae7b527f63edb824e1","Type":"ContainerStarted","Data":"8e82637ada132d93286cb1826b9b11d667bd2c1332cae0c1071afc82bdd9fc01"}
Jul 09 18:04:43.197737 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.197626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52r8t" event={"ID":"d2c30535-1255-4b1f-9e87-5c146bfd3088","Type":"ContainerStarted","Data":"da20951ab6005c63a539ff0801121d8fc0815f07a9b397510d38235278e5e586"}
Jul 09 18:04:43.207225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.207105    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85" event={"ID":"5006d8f7-d558-4269-9f13-02400e8a008f","Type":"ContainerStarted","Data":"69d85cd95f2b5db84cbf5c6f975853a54752aa7e7adf3fc4da035cfd2c76096c"}
Jul 09 18:04:43.219486 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:43.219438    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"95a637e0838d9476d7d5851099ec73c0001f8b703befbd63c5fb2eb502022342"}
Jul 09 18:04:44.239215 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:44.239020    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal" event={"ID":"971cacb371a35a47b8e39af3fe63cd43","Type":"ContainerStarted","Data":"defc10822e26f2d00f4e0ce6c10f9de9fcf0fa50008fff1cbe5649a6d8cd53e6"}
Jul 09 18:04:44.263281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:44.262185    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-205.ec2.internal" podStartSLOduration=4.262162167 podStartE2EDuration="4.262162167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:43.216049168 +0000 UTC m=+4.715105917" watchObservedRunningTime="2026-07-09 18:04:44.262162167 +0000 UTC m=+5.761218988"
Jul 09 18:04:44.652415 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:44.652326    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:44.652415 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:44.652397    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:44.652629 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:44.652430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:44.652629 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:44.652578    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:44.652740 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:44.652647    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret podName:d8ab92ab-b3bb-4440-a0a2-39c193c64a15 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:48.652627071 +0000 UTC m=+10.151683801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret") pod "global-pull-secret-syncer-pszsp" (UID: "d8ab92ab-b3bb-4440-a0a2-39c193c64a15") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:44.653122 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:44.653101    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:04:44.653217 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:44.653131    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:04:44.653217 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:44.653145    2569 projected.go:196] Error preparing data for projected volume kube-api-access-c7qgf for pod openshift-network-diagnostics/network-check-target-jr4r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:44.653217 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:44.653195    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf podName:e74513ee-2955-47cf-9ae4-5f4f7b911bde nodeName:}" failed. No retries permitted until 2026-07-09 18:04:48.653179582 +0000 UTC m=+10.152236322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7qgf" (UniqueName: "kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf") pod "network-check-target-jr4r4" (UID: "e74513ee-2955-47cf-9ae4-5f4f7b911bde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:44.653389 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:44.653262    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:44.653389 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:44.653296    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs podName:bcf7e722-8a18-4a9c-9a03-b8033505fc4e nodeName:}" failed. No retries permitted until 2026-07-09 18:04:48.653284654 +0000 UTC m=+10.152341385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs") pod "network-metrics-daemon-msmqp" (UID: "bcf7e722-8a18-4a9c-9a03-b8033505fc4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:45.117266 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:45.117180    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:45.117436 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:45.117340    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:45.117776 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:45.117755    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:45.117875 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:45.117854    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:45.119926 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:45.119899    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:45.120045 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:45.120017    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:47.117209 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:47.116628    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:47.117209 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:47.116778    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:47.117209 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:47.116833    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:47.117209 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:47.116921    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:47.117209 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:47.116948    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:47.117209 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:47.117087    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:48.684724 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:48.684681    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:48.684744    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:48.684774    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:48.684905    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:48.684906    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:48.684939    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:48.684953    2569 projected.go:196] Error preparing data for projected volume kube-api-access-c7qgf for pod openshift-network-diagnostics/network-check-target-jr4r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:48.684974    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret podName:d8ab92ab-b3bb-4440-a0a2-39c193c64a15 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:56.684953861 +0000 UTC m=+18.184010597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret") pod "global-pull-secret-syncer-pszsp" (UID: "d8ab92ab-b3bb-4440-a0a2-39c193c64a15") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:48.685014    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf podName:e74513ee-2955-47cf-9ae4-5f4f7b911bde nodeName:}" failed. No retries permitted until 2026-07-09 18:04:56.684995939 +0000 UTC m=+18.184052666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7qgf" (UniqueName: "kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf") pod "network-check-target-jr4r4" (UID: "e74513ee-2955-47cf-9ae4-5f4f7b911bde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:48.685110    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:48.685218 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:48.685150    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs podName:bcf7e722-8a18-4a9c-9a03-b8033505fc4e nodeName:}" failed. No retries permitted until 2026-07-09 18:04:56.685136579 +0000 UTC m=+18.184193307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs") pod "network-metrics-daemon-msmqp" (UID: "bcf7e722-8a18-4a9c-9a03-b8033505fc4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:49.117519 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:49.117431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:49.117690 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:49.117524    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:49.117690 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:49.117547    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:49.117690 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:49.117663    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:49.117848 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:49.117701    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:49.117848 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:49.117778    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:51.116515 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:51.116470    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:51.116515 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:51.116498    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:51.117126 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:51.116501    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:51.117126 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:51.116619    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:51.117126 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:51.116727    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:51.117126 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:51.116780    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:53.116835 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:53.116748    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:53.117309 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:53.116749    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:53.117309 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:53.116890    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:53.117309 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:53.116935    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:53.117309 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:53.117042    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:53.117309 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:53.117169    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:55.116708 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:55.116669    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:55.116708 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:55.116706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:55.117244 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:55.116669    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:55.117244 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:55.116818    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:55.117244 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:55.116915    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:55.117244 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:55.117052    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:56.749711 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:56.749676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:56.749711 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:56.749710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:56.749746    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:56.749820    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:56.749831    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:56.749832    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:56.749872    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs podName:bcf7e722-8a18-4a9c-9a03-b8033505fc4e nodeName:}" failed. No retries permitted until 2026-07-09 18:05:12.749856073 +0000 UTC m=+34.248912799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs") pod "network-metrics-daemon-msmqp" (UID: "bcf7e722-8a18-4a9c-9a03-b8033505fc4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:56.749843    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:56.749885    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret podName:d8ab92ab-b3bb-4440-a0a2-39c193c64a15 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:12.749879104 +0000 UTC m=+34.248935829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret") pod "global-pull-secret-syncer-pszsp" (UID: "d8ab92ab-b3bb-4440-a0a2-39c193c64a15") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:56.749888    2569 projected.go:196] Error preparing data for projected volume kube-api-access-c7qgf for pod openshift-network-diagnostics/network-check-target-jr4r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:56.750148 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:56.749920    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf podName:e74513ee-2955-47cf-9ae4-5f4f7b911bde nodeName:}" failed. No retries permitted until 2026-07-09 18:05:12.749907519 +0000 UTC m=+34.248964248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7qgf" (UniqueName: "kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf") pod "network-check-target-jr4r4" (UID: "e74513ee-2955-47cf-9ae4-5f4f7b911bde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:04:57.116530 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:57.116480    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:57.116718 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:57.116485    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:57.116718 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:57.116619    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:57.116718 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:57.116493    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:57.116899 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:57.116740    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:57.117126 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:57.117079    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:04:59.116742 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:59.116688    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:04:59.117221 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:59.116815    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:04:59.117221 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:59.116829    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:04:59.117221 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:04:59.117015    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:04:59.117221 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:59.117046    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:04:59.117221 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:04:59.117101    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:01.116490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:01.116461    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:01.116490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:01.116479    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:01.117034 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:01.116611    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:05:01.117034 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:01.116743    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:01.117034 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:01.116930    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:01.117034 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:01.117015    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:05:02.281602 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.281231    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwk5m" event={"ID":"8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a","Type":"ContainerStarted","Data":"14e644e9beedba6c0464e962d4e5762600aa6621ce5a3e542ab05058d304fd58"}
Jul 09 18:05:02.282889 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.282854    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p867f" event={"ID":"2d159c5e-5891-4508-93bc-dad49b37d682","Type":"ContainerStarted","Data":"612e80bcac279e93f6f4e5945f144a3112faa8889e55e4dea6d464f1b6a01c6d"}
Jul 09 18:05:02.284537 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.284507    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5n5wn" event={"ID":"c5d4b889-895b-4c71-a943-85aae52800fe","Type":"ContainerStarted","Data":"aa17b642af420f29d1db9732ddf56755f780f6258efeac4fc2300bd7b81070dd"}
Jul 09 18:05:02.286152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.286118    2569 generic.go:356] "Generic (PLEG): container finished" podID="722305f7-f162-451c-809a-301a9fc7b0b4" containerID="1f80eae68d172071e4593e6de1a47aba633632f96319b4ed4f03c5a72d818d59" exitCode=0
Jul 09 18:05:02.286283 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.286191    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4vs42" event={"ID":"722305f7-f162-451c-809a-301a9fc7b0b4","Type":"ContainerDied","Data":"1f80eae68d172071e4593e6de1a47aba633632f96319b4ed4f03c5a72d818d59"}
Jul 09 18:05:02.288271 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.288221    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mx7g4" event={"ID":"e3f6f546-6c19-4bd6-89f6-5b049cad7bde","Type":"ContainerStarted","Data":"032925ec9396a8f44a18b5d791a6a157abbeada9dce0aab3ccbc33bd9f247f2b"}
Jul 09 18:05:02.290128 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.290080    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52r8t" event={"ID":"d2c30535-1255-4b1f-9e87-5c146bfd3088","Type":"ContainerStarted","Data":"2c0e1eaf3b6ec0eb0eaa539b6d0b1f008e3f8208679f1d5eaa88afa92bbf49b9"}
Jul 09 18:05:02.291818 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.291793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85" event={"ID":"5006d8f7-d558-4269-9f13-02400e8a008f","Type":"ContainerStarted","Data":"10ba452eeadef00136c71c0f3f81a79dc35ca32e23430715c907c551ce138ab9"}
Jul 09 18:05:02.294676 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.294657    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:05:02.295002 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.294976    2569 generic.go:356] "Generic (PLEG): container finished" podID="6572fa80-150a-46a3-b8e6-cf50e2ad9d13" containerID="71ee8c5889c879120d5338971976995b1453ee549eb8b065eb76caaee4ce0af9" exitCode=1
Jul 09 18:05:02.295119 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.295018    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"5f796cfe8c7fbfcc782d3ee9596939d56b9baeaf4d1225e35179bded562f2e51"}
Jul 09 18:05:02.295119 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.295110    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"e3518275cbfcab3de1c9570a11822b5ff153c05a113b13dda0aba4b0817789d2"}
Jul 09 18:05:02.295246 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.295165    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"18a132bb4e0be122660ea55fc917a700ea3ed7053b4051ce20af1a543ff12ee3"}
Jul 09 18:05:02.295246 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.295219    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"7df6d7c6968865361134431a1a89856862717955936b0b8710e79c5a35faa623"}
Jul 09 18:05:02.295346 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.295272    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerDied","Data":"71ee8c5889c879120d5338971976995b1453ee549eb8b065eb76caaee4ce0af9"}
Jul 09 18:05:02.295346 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.295326    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"092516aa696d96fd93dc35c2a33e0b5014d03a1b2e33caaca9fbca445b2cc25a"}
Jul 09 18:05:02.301329 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.299386    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cwk5m" podStartSLOduration=4.315742881 podStartE2EDuration="23.299358095s" totalImagesPullingTime="18.983615214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:02.298733408 +0000 UTC m=+23.797790156" watchObservedRunningTime="2026-07-09 18:05:02.299358095 +0000 UTC m=+23.798414843"
Jul 09 18:05:02.301329 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.300148    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-205.ec2.internal" podStartSLOduration=22.300131719 podStartE2EDuration="22.300131719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:44.263262878 +0000 UTC m=+5.762319638" watchObservedRunningTime="2026-07-09 18:05:02.300131719 +0000 UTC m=+23.799188468"
Jul 09 18:05:02.324353 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.324307    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p867f" podStartSLOduration=4.334428426 podStartE2EDuration="23.324289737s" totalImagesPullingTime="18.989861311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:02.323928018 +0000 UTC m=+23.822984765" watchObservedRunningTime="2026-07-09 18:05:02.324289737 +0000 UTC m=+23.823346484"
Jul 09 18:05:02.383037 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.382986    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-52r8t" podStartSLOduration=4.396601763 podStartE2EDuration="23.38297112s" totalImagesPullingTime="18.986369357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:02.382483364 +0000 UTC m=+23.881540112" watchObservedRunningTime="2026-07-09 18:05:02.38297112 +0000 UTC m=+23.882027867"
Jul 09 18:05:02.402350 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.402305    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5n5wn" podStartSLOduration=4.376367384 podStartE2EDuration="23.402290366s" totalImagesPullingTime="19.025922982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:02.402108564 +0000 UTC m=+23.901165311" watchObservedRunningTime="2026-07-09 18:05:02.402290366 +0000 UTC m=+23.901347113"
Jul 09 18:05:02.422410 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:02.422335    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mx7g4" podStartSLOduration=4.417581962 podStartE2EDuration="23.422313497s" totalImagesPullingTime="19.004731535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:02.421386113 +0000 UTC m=+23.920442859" watchObservedRunningTime="2026-07-09 18:05:02.422313497 +0000 UTC m=+23.921370245"
Jul 09 18:05:03.116507 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:03.116476    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:03.116711 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:03.116476    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:03.116711 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:03.116605    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:05:03.116711 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:03.116634    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:03.116884 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:03.116711    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:03.116884 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:03.116782    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:05:03.145898 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:03.145869    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 18:05:03.299092 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:03.299046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85" event={"ID":"5006d8f7-d558-4269-9f13-02400e8a008f","Type":"ContainerStarted","Data":"3b8e62b61a714d2bac9eccdb0f030f4939ef1353453168df5121f0caa0a687b8"}
Jul 09 18:05:03.300955 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:03.300924    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twt8f" event={"ID":"dc24bbc8-0261-40dc-8ffe-b7ce7c209c60","Type":"ContainerStarted","Data":"c9b6be82d68d72c07c90bfcd7833f44134e78cf65336c5a34ab223f4d568c7df"}
Jul 09 18:05:03.319854 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:03.319799    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-twt8f" podStartSLOduration=5.328340439 podStartE2EDuration="24.319776321s" totalImagesPullingTime="18.991435882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:03.319534748 +0000 UTC m=+24.818591491" watchObservedRunningTime="2026-07-09 18:05:03.319776321 +0000 UTC m=+24.818833069"
Jul 09 18:05:03.998043 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:03.997885    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:05:03.145892369Z","UUID":"d255367f-6139-411f-8ffa-8ae6839675f3","Handler":null,"Name":"","Endpoint":""}
Jul 09 18:05:04.000096 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:04.000069    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 18:05:04.000229 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:04.000109    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 18:05:04.860570 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:04.860308    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:05:04.861005 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:04.860967    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:05:05.116253 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:05.116176    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:05.116546 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:05.116185    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:05.116546 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:05.116313    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:05:05.116546 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:05.116185    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:05.116546 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:05.116368    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:05.116546 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:05.116428    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:05:05.308233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:05.308193    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85" event={"ID":"5006d8f7-d558-4269-9f13-02400e8a008f","Type":"ContainerStarted","Data":"d90ed3fca054b2efefb688c859be6048618d0682aa2345a907679307984ac6f2"}
Jul 09 18:05:05.311102 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:05.311077    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:05:05.311580 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:05.311527    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"929a6ce6437147cf960dca50880b945bcd34e334826a0f5530729d0fa017ad8d"}
Jul 09 18:05:05.350931 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:05.350884    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f8z85" podStartSLOduration=4.421641122 podStartE2EDuration="26.350864558s" totalImagesPullingTime="21.929223436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:05.350496474 +0000 UTC m=+26.849553220" watchObservedRunningTime="2026-07-09 18:05:05.350864558 +0000 UTC m=+26.849921308"
Jul 09 18:05:07.121745 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.121540    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:07.122590 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.121577    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:07.122590 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:07.121853    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:05:07.122590 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.121609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:07.122590 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:07.121937    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:05:07.122590 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:07.122010    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:07.320335 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.320307    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:05:07.320697 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.320667    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"2e9b58d1ee7a00ceee48ed32f1f1ce57589fd6ef22412a62827dee19be4d4710"}
Jul 09 18:05:07.321018 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.320992    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:05:07.321143 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.321087    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:05:07.321204 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.321178    2569 scope.go:117] "RemoveContainer" containerID="71ee8c5889c879120d5338971976995b1453ee549eb8b065eb76caaee4ce0af9"
Jul 09 18:05:07.339649 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:07.339627    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:05:08.327012 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.326986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:05:08.327396 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.327372    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" event={"ID":"6572fa80-150a-46a3-b8e6-cf50e2ad9d13","Type":"ContainerStarted","Data":"e11669a4740aea3488de4995c4598a6d109183b7716160e7637b894400f83811"}
Jul 09 18:05:08.327827 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.327804    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:05:08.343199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.343175    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:05:08.434431 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.434381    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn" podStartSLOduration=10.12998761 podStartE2EDuration="29.434365712s" totalImagesPullingTime="19.304378102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:08.378492954 +0000 UTC m=+29.877549854" watchObservedRunningTime="2026-07-09 18:05:08.434365712 +0000 UTC m=+29.933422459"
Jul 09 18:05:08.839211 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.839178    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jr4r4"]
Jul 09 18:05:08.839374 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.839309    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:08.839431 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:08.839389    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:08.845268 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.845243    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pszsp"]
Jul 09 18:05:08.845406 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.845363    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:08.845985 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:08.845463    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:05:08.846099 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.845985    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-msmqp"]
Jul 09 18:05:08.846138 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.846113    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:08.846241 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:08.846216    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:05:08.977843 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.977806    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:05:08.978019 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.977940    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:05:08.978441 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:08.978415    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cwk5m"
Jul 09 18:05:09.331861 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:09.331682    2569 generic.go:356] "Generic (PLEG): container finished" podID="722305f7-f162-451c-809a-301a9fc7b0b4" containerID="af5574fb495a7cd8171d0411a2e1393df8319449540a7c383af1a23580c80829" exitCode=0
Jul 09 18:05:09.332244 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:09.331766    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4vs42" event={"ID":"722305f7-f162-451c-809a-301a9fc7b0b4","Type":"ContainerDied","Data":"af5574fb495a7cd8171d0411a2e1393df8319449540a7c383af1a23580c80829"}
Jul 09 18:05:10.116491 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:10.116448    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:10.116491 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:10.116491    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:10.116753 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:10.116612    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:05:10.116753 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:10.116730    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:05:11.116200 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:11.116163    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:11.116827 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:11.116268    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:11.338452 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:11.338420    2569 generic.go:356] "Generic (PLEG): container finished" podID="722305f7-f162-451c-809a-301a9fc7b0b4" containerID="1d781cd25da1c82fbaaabbc53b2dc8de8b77c78aba66fa0319107cf770d8cb8b" exitCode=0
Jul 09 18:05:11.338587 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:11.338502    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4vs42" event={"ID":"722305f7-f162-451c-809a-301a9fc7b0b4","Type":"ContainerDied","Data":"1d781cd25da1c82fbaaabbc53b2dc8de8b77c78aba66fa0319107cf770d8cb8b"}
Jul 09 18:05:12.116421 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:12.116391    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:12.116421 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:12.116405    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:12.116813 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.116494    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:05:12.116813 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.116614    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:05:12.773146 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:12.773111    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:12.773146 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:12.773154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:12.773377 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.773267    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:05:12.773377 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.773284    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:05:12.773377 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:12.773302    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:12.773377 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.773326    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret podName:d8ab92ab-b3bb-4440-a0a2-39c193c64a15 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:44.773313673 +0000 UTC m=+66.272370398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret") pod "global-pull-secret-syncer-pszsp" (UID: "d8ab92ab-b3bb-4440-a0a2-39c193c64a15") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:05:12.773559 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.773390    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:05:12.773559 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.773408    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:05:12.773559 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.773418    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs podName:bcf7e722-8a18-4a9c-9a03-b8033505fc4e nodeName:}" failed. No retries permitted until 2026-07-09 18:05:44.773391772 +0000 UTC m=+66.272448504 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs") pod "network-metrics-daemon-msmqp" (UID: "bcf7e722-8a18-4a9c-9a03-b8033505fc4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:05:12.773559 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.773420    2569 projected.go:196] Error preparing data for projected volume kube-api-access-c7qgf for pod openshift-network-diagnostics/network-check-target-jr4r4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:05:12.773559 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:12.773493    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf podName:e74513ee-2955-47cf-9ae4-5f4f7b911bde nodeName:}" failed. No retries permitted until 2026-07-09 18:05:44.773480873 +0000 UTC m=+66.272537621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7qgf" (UniqueName: "kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf") pod "network-check-target-jr4r4" (UID: "e74513ee-2955-47cf-9ae4-5f4f7b911bde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:05:13.116558 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:13.116532    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:13.117011 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:13.116680    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:13.345589 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:13.345487    2569 generic.go:356] "Generic (PLEG): container finished" podID="722305f7-f162-451c-809a-301a9fc7b0b4" containerID="10e47d0f4865b7709a4c82bfbe2493d0b33c449a4580043f2f839ea9da58adc2" exitCode=0
Jul 09 18:05:13.345589 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:13.345553    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4vs42" event={"ID":"722305f7-f162-451c-809a-301a9fc7b0b4","Type":"ContainerDied","Data":"10e47d0f4865b7709a4c82bfbe2493d0b33c449a4580043f2f839ea9da58adc2"}
Jul 09 18:05:14.116539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:14.116501    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:14.116711 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:14.116546    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:14.116711 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:14.116636    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pszsp" podUID="d8ab92ab-b3bb-4440-a0a2-39c193c64a15"
Jul 09 18:05:14.117112 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:14.116741    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-msmqp" podUID="bcf7e722-8a18-4a9c-9a03-b8033505fc4e"
Jul 09 18:05:15.116315 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.115840    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:15.116454 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:15.116390    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr4r4" podUID="e74513ee-2955-47cf-9ae4-5f4f7b911bde"
Jul 09 18:05:15.338611 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.338582    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-205.ec2.internal" event="NodeReady"
Jul 09 18:05:15.339000 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.338727    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 18:05:15.433477 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.433374    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6df5857564-n8gs4"]
Jul 09 18:05:15.435419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.435384    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.440612 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.440587    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 18:05:15.441279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.441247    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4mr58\""
Jul 09 18:05:15.442266 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.442039    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 18:05:15.446239 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.446207    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 18:05:15.451952 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.451925    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 18:05:15.459451 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.459406    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x9lzn"]
Jul 09 18:05:15.461780 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.461689    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tx2nj"]
Jul 09 18:05:15.461941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.461840    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.463501 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.463470    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df5857564-n8gs4"]
Jul 09 18:05:15.463625 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.463569    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tx2nj"
Jul 09 18:05:15.488611 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.488581    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 18:05:15.488784 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.488631    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 18:05:15.488784 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.488649    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 18:05:15.488784 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.488581    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 18:05:15.489076 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.489041    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nq7m5\""
Jul 09 18:05:15.489198 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.489043    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 18:05:15.494906 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.494886    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bf4m7\""
Jul 09 18:05:15.515251 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.515101    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tx2nj"]
Jul 09 18:05:15.519324 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.517099    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9lzn"]
Jul 09 18:05:15.595078 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595031    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkwkn\" (UniqueName: \"kubernetes.io/projected/33409e0d-4142-4dbe-abab-eb283eee9edc-kube-api-access-gkwkn\") pod \"ingress-canary-tx2nj\" (UID: \"33409e0d-4142-4dbe-abab-eb283eee9edc\") " pod="openshift-ingress-canary/ingress-canary-tx2nj"
Jul 09 18:05:15.595078 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-trusted-ca\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.595333 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.595333 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33409e0d-4142-4dbe-abab-eb283eee9edc-cert\") pod \"ingress-canary-tx2nj\" (UID: \"33409e0d-4142-4dbe-abab-eb283eee9edc\") " pod="openshift-ingress-canary/ingress-canary-tx2nj"
Jul 09 18:05:15.595333 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595209    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-certificates\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.595333 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0acb8592-4eba-439a-97fc-189710a23316-tmp-dir\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.595333 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-installation-pull-secrets\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.595592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-image-registry-private-configuration\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.595592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595392    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-ca-trust-extracted\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.595592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595430    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-bound-sa-token\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.595592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0acb8592-4eba-439a-97fc-189710a23316-config-volume\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.595592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glv8p\" (UniqueName: \"kubernetes.io/projected/0acb8592-4eba-439a-97fc-189710a23316-kube-api-access-glv8p\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.595592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595533    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.595592 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.595563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4sr2\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-kube-api-access-c4sr2\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.696252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696166    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0acb8592-4eba-439a-97fc-189710a23316-tmp-dir\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.696252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-installation-pull-secrets\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.696474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-image-registry-private-configuration\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.696474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-ca-trust-extracted\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.696474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-bound-sa-token\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.696474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0acb8592-4eba-439a-97fc-189710a23316-config-volume\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.696474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glv8p\" (UniqueName: \"kubernetes.io/projected/0acb8592-4eba-439a-97fc-189710a23316-kube-api-access-glv8p\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.696474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.696474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696405    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4sr2\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-kube-api-access-c4sr2\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.696474 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696445    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkwkn\" (UniqueName: \"kubernetes.io/projected/33409e0d-4142-4dbe-abab-eb283eee9edc-kube-api-access-gkwkn\") pod \"ingress-canary-tx2nj\" (UID: \"33409e0d-4142-4dbe-abab-eb283eee9edc\") " pod="openshift-ingress-canary/ingress-canary-tx2nj"
Jul 09 18:05:15.696875 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0acb8592-4eba-439a-97fc-189710a23316-tmp-dir\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.696875 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696681    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-trusted-ca\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.696875 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696735    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.696875 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33409e0d-4142-4dbe-abab-eb283eee9edc-cert\") pod \"ingress-canary-tx2nj\" (UID: \"33409e0d-4142-4dbe-abab-eb283eee9edc\") " pod="openshift-ingress-canary/ingress-canary-tx2nj"
Jul 09 18:05:15.696875 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-certificates\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.697154 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696736    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-ca-trust-extracted\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.697154 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:15.696901    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:05:15.697154 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:15.696919    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5857564-n8gs4: secret "image-registry-tls" not found
Jul 09 18:05:15.697154 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.696946    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0acb8592-4eba-439a-97fc-189710a23316-config-volume\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.697154 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:15.696971    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:05:15.697154 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:15.696973    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls podName:cd74ba77-ad4e-4f1c-85c3-9505da42b9b6 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:16.196954685 +0000 UTC m=+37.696011429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls") pod "image-registry-6df5857564-n8gs4" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6") : secret "image-registry-tls" not found
Jul 09 18:05:15.697154 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:15.697035    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls podName:0acb8592-4eba-439a-97fc-189710a23316 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:16.197015787 +0000 UTC m=+37.696072514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls") pod "dns-default-x9lzn" (UID: "0acb8592-4eba-439a-97fc-189710a23316") : secret "dns-default-metrics-tls" not found
Jul 09 18:05:15.698490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.698462    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-trusted-ca\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.698704 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.698678    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-certificates\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.701125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.701103    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33409e0d-4142-4dbe-abab-eb283eee9edc-cert\") pod \"ingress-canary-tx2nj\" (UID: \"33409e0d-4142-4dbe-abab-eb283eee9edc\") " pod="openshift-ingress-canary/ingress-canary-tx2nj"
Jul 09 18:05:15.701234 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.701128    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-image-registry-private-configuration\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.701234 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.701103    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-installation-pull-secrets\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.736986 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.736949    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-bound-sa-token\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.737188 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.737009    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glv8p\" (UniqueName: \"kubernetes.io/projected/0acb8592-4eba-439a-97fc-189710a23316-kube-api-access-glv8p\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:15.738765 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.738731    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkwkn\" (UniqueName: \"kubernetes.io/projected/33409e0d-4142-4dbe-abab-eb283eee9edc-kube-api-access-gkwkn\") pod \"ingress-canary-tx2nj\" (UID: \"33409e0d-4142-4dbe-abab-eb283eee9edc\") " pod="openshift-ingress-canary/ingress-canary-tx2nj"
Jul 09 18:05:15.739795 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.739770    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4sr2\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-kube-api-access-c4sr2\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:15.778830 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:15.778791    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tx2nj"
Jul 09 18:05:16.116605 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:16.116571    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:16.116779 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:16.116609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:16.120102 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:16.120074    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vhwtc\""
Jul 09 18:05:16.120256 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:16.120075    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:05:16.120565 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:16.120546    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:05:16.201688 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:16.201648    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:16.201848 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:16.201705    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:16.201848 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:16.201818    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:05:16.201848 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:16.201835    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5857564-n8gs4: secret "image-registry-tls" not found
Jul 09 18:05:16.201848 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:16.201840    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:05:16.202037 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:16.201898    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls podName:0acb8592-4eba-439a-97fc-189710a23316 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:17.201883624 +0000 UTC m=+38.700940349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls") pod "dns-default-x9lzn" (UID: "0acb8592-4eba-439a-97fc-189710a23316") : secret "dns-default-metrics-tls" not found
Jul 09 18:05:16.202037 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:16.201915    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls podName:cd74ba77-ad4e-4f1c-85c3-9505da42b9b6 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:17.20190725 +0000 UTC m=+38.700963974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls") pod "image-registry-6df5857564-n8gs4" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6") : secret "image-registry-tls" not found
Jul 09 18:05:17.116444 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:17.116411    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:17.120464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:17.120424    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vcghf\""
Jul 09 18:05:17.121339 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:17.121317    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:05:17.121472 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:17.121354    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:05:17.210941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:17.210908    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:17.211139 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:17.210965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:17.211139 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:17.211080    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:05:17.211139 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:17.211095    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5857564-n8gs4: secret "image-registry-tls" not found
Jul 09 18:05:17.211298 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:17.211151    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:05:17.211298 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:17.211155    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls podName:cd74ba77-ad4e-4f1c-85c3-9505da42b9b6 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:19.211134005 +0000 UTC m=+40.710190943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls") pod "image-registry-6df5857564-n8gs4" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6") : secret "image-registry-tls" not found
Jul 09 18:05:17.211298 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:17.211233    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls podName:0acb8592-4eba-439a-97fc-189710a23316 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:19.211218852 +0000 UTC m=+40.710275591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls") pod "dns-default-x9lzn" (UID: "0acb8592-4eba-439a-97fc-189710a23316") : secret "dns-default-metrics-tls" not found
Jul 09 18:05:17.458127 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:17.458095    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tx2nj"]
Jul 09 18:05:17.561643 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:05:17.561603    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33409e0d_4142_4dbe_abab_eb283eee9edc.slice/crio-ababff4a0b1d160fbb0f5ea592ed13419458ebe8a6124ef3d6e526f905349c15 WatchSource:0}: Error finding container ababff4a0b1d160fbb0f5ea592ed13419458ebe8a6124ef3d6e526f905349c15: Status 404 returned error can't find the container with id ababff4a0b1d160fbb0f5ea592ed13419458ebe8a6124ef3d6e526f905349c15
Jul 09 18:05:18.360617 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:18.360374    2569 generic.go:356] "Generic (PLEG): container finished" podID="722305f7-f162-451c-809a-301a9fc7b0b4" containerID="6212f172fedd6fdf9bf989b3232c8d9d651452e466adb2c9cb19b023ea1094f8" exitCode=0
Jul 09 18:05:18.361048 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:18.360451    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4vs42" event={"ID":"722305f7-f162-451c-809a-301a9fc7b0b4","Type":"ContainerDied","Data":"6212f172fedd6fdf9bf989b3232c8d9d651452e466adb2c9cb19b023ea1094f8"}
Jul 09 18:05:18.361963 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:18.361936    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tx2nj" event={"ID":"33409e0d-4142-4dbe-abab-eb283eee9edc","Type":"ContainerStarted","Data":"ababff4a0b1d160fbb0f5ea592ed13419458ebe8a6124ef3d6e526f905349c15"}
Jul 09 18:05:19.229095 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:19.229039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:19.229311 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:19.229163    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:19.229311 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:19.229238    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:05:19.229311 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:19.229283    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:05:19.229311 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:19.229297    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5857564-n8gs4: secret "image-registry-tls" not found
Jul 09 18:05:19.229537 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:19.229332    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls podName:0acb8592-4eba-439a-97fc-189710a23316 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:23.229309728 +0000 UTC m=+44.728366475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls") pod "dns-default-x9lzn" (UID: "0acb8592-4eba-439a-97fc-189710a23316") : secret "dns-default-metrics-tls" not found
Jul 09 18:05:19.229537 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:19.229357    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls podName:cd74ba77-ad4e-4f1c-85c3-9505da42b9b6 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:23.22935076 +0000 UTC m=+44.728407531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls") pod "image-registry-6df5857564-n8gs4" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6") : secret "image-registry-tls" not found
Jul 09 18:05:19.368191 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:19.368150    2569 generic.go:356] "Generic (PLEG): container finished" podID="722305f7-f162-451c-809a-301a9fc7b0b4" containerID="c610e33f2a5b1a74f3b19dbdbf5f7a453b0009a1531e490860e007152b2fceb5" exitCode=0
Jul 09 18:05:19.368729 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:19.368201    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4vs42" event={"ID":"722305f7-f162-451c-809a-301a9fc7b0b4","Type":"ContainerDied","Data":"c610e33f2a5b1a74f3b19dbdbf5f7a453b0009a1531e490860e007152b2fceb5"}
Jul 09 18:05:20.374850 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:20.374811    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4vs42" event={"ID":"722305f7-f162-451c-809a-301a9fc7b0b4","Type":"ContainerStarted","Data":"ef92ddd9982cb8228f79c5f9276849fd8ab1898ae52d4abb922774accc0e22b3"}
Jul 09 18:05:20.407119 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:20.407036    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4vs42" podStartSLOduration=9.484314414 podStartE2EDuration="41.407012217s" totalImagesPullingTime="31.922697803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:20.405206793 +0000 UTC m=+41.904263542" watchObservedRunningTime="2026-07-09 18:05:20.407012217 +0000 UTC m=+41.906068967"
Jul 09 18:05:21.378717 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:21.378672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tx2nj" event={"ID":"33409e0d-4142-4dbe-abab-eb283eee9edc","Type":"ContainerStarted","Data":"63dc9a2d1f82dbb9c6d533044a5b1374040104b23db1e751d3a2315e2381f1ac"}
Jul 09 18:05:21.408189 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:21.408141    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tx2nj" podStartSLOduration=3.014640303 podStartE2EDuration="6.408108108s" totalImagesPullingTime="3.393467805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:21.40772415 +0000 UTC m=+42.906780898" watchObservedRunningTime="2026-07-09 18:05:21.408108108 +0000 UTC m=+42.907164834"
Jul 09 18:05:23.260313 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:23.260274    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:23.260747 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:23.260324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:23.260747 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:23.260425    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:05:23.260747 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:23.260429    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:05:23.260747 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:23.260446    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5857564-n8gs4: secret "image-registry-tls" not found
Jul 09 18:05:23.260747 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:23.260503    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls podName:0acb8592-4eba-439a-97fc-189710a23316 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:31.260487493 +0000 UTC m=+52.759544219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls") pod "dns-default-x9lzn" (UID: "0acb8592-4eba-439a-97fc-189710a23316") : secret "dns-default-metrics-tls" not found
Jul 09 18:05:23.260747 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:23.260518    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls podName:cd74ba77-ad4e-4f1c-85c3-9505da42b9b6 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:31.260512105 +0000 UTC m=+52.759568879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls") pod "image-registry-6df5857564-n8gs4" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6") : secret "image-registry-tls" not found
Jul 09 18:05:29.586307 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.586272    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hm7gs"]
Jul 09 18:05:29.601717 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.601696    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.604673 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.604648    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 18:05:29.604813 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.604753    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 18:05:29.604873 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.604819    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 18:05:29.606001 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.605983    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 18:05:29.606112 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.605987    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qh478\""
Jul 09 18:05:29.608391 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.608372    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hm7gs"]
Jul 09 18:05:29.708025 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.707987    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6859cd39-155a-4995-8555-ca166ee428f3-data-volume\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.708025 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.708026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6859cd39-155a-4995-8555-ca166ee428f3-crio-socket\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.708277 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.708079    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.708277 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.708204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.708277 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.708249    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6chm\" (UniqueName: \"kubernetes.io/projected/6859cd39-155a-4995-8555-ca166ee428f3-kube-api-access-f6chm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.808958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.808924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6859cd39-155a-4995-8555-ca166ee428f3-crio-socket\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.808958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.808962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.809204 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.809020    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.809204 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.809041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6chm\" (UniqueName: \"kubernetes.io/projected/6859cd39-155a-4995-8555-ca166ee428f3-kube-api-access-f6chm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.809204 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.809096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6859cd39-155a-4995-8555-ca166ee428f3-data-volume\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.809204 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:29.809141    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:05:29.809204 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:29.809163    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:29.809204 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.809163    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6859cd39-155a-4995-8555-ca166ee428f3-crio-socket\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.809473 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:29.809227    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:30.309206844 +0000 UTC m=+51.808263569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : configmap "kube-rbac-proxy" not found
Jul 09 18:05:29.809473 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:29.809250    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:30.309239278 +0000 UTC m=+51.808296006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:29.809473 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.809394    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6859cd39-155a-4995-8555-ca166ee428f3-data-volume\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:29.821419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:29.821397    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6chm\" (UniqueName: \"kubernetes.io/projected/6859cd39-155a-4995-8555-ca166ee428f3-kube-api-access-f6chm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:30.312464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:30.312431    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:30.312641 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:30.312501    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:30.312641 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:30.312558    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:05:30.312641 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:30.312620    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:31.31260233 +0000 UTC m=+52.811659058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : configmap "kube-rbac-proxy" not found
Jul 09 18:05:30.312641 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:30.312620    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:30.312832 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:30.312694    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:31.312677654 +0000 UTC m=+52.811734391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:31.319256 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:31.319215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:31.319256 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:31.319263    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:31.319320    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:31.319341    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319378    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319436    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319447    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319457    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls podName:0acb8592-4eba-439a-97fc-189710a23316 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:47.319439065 +0000 UTC m=+68.818495800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls") pod "dns-default-x9lzn" (UID: "0acb8592-4eba-439a-97fc-189710a23316") : secret "dns-default-metrics-tls" not found
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319483    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:33.319471179 +0000 UTC m=+54.818527906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319439    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319499    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:33.319491284 +0000 UTC m=+54.818548009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : configmap "kube-rbac-proxy" not found
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319501    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5857564-n8gs4: secret "image-registry-tls" not found
Jul 09 18:05:31.319880 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:31.319536    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls podName:cd74ba77-ad4e-4f1c-85c3-9505da42b9b6 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:47.319525369 +0000 UTC m=+68.818582128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls") pod "image-registry-6df5857564-n8gs4" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6") : secret "image-registry-tls" not found
Jul 09 18:05:32.367424 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.367391    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pttqx"]
Jul 09 18:05:32.374213 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.374193    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52r8t_d2c30535-1255-4b1f-9e87-5c146bfd3088/dns-node-resolver/0.log"
Jul 09 18:05:32.389043 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.389021    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pttqx"]
Jul 09 18:05:32.389176 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.389124    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.392303 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.392283    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 18:05:32.392303 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.392292    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 18:05:32.392469 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.392294    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 18:05:32.393599 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.393580    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-trxkx\""
Jul 09 18:05:32.393692 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.393609    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 18:05:32.428488 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.428462    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eb57943c-ecbc-42cd-8bb1-9439b78a1801-signing-cabundle\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.428597 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.428569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eb57943c-ecbc-42cd-8bb1-9439b78a1801-signing-key\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.428638 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.428598    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjcm\" (UniqueName: \"kubernetes.io/projected/eb57943c-ecbc-42cd-8bb1-9439b78a1801-kube-api-access-xdjcm\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.529065 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.529030    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eb57943c-ecbc-42cd-8bb1-9439b78a1801-signing-cabundle\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.529196 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.529143    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eb57943c-ecbc-42cd-8bb1-9439b78a1801-signing-key\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.529196 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.529161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjcm\" (UniqueName: \"kubernetes.io/projected/eb57943c-ecbc-42cd-8bb1-9439b78a1801-kube-api-access-xdjcm\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.529761 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.529737    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eb57943c-ecbc-42cd-8bb1-9439b78a1801-signing-cabundle\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.531498 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.531476    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eb57943c-ecbc-42cd-8bb1-9439b78a1801-signing-key\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.539085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.539050    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjcm\" (UniqueName: \"kubernetes.io/projected/eb57943c-ecbc-42cd-8bb1-9439b78a1801-kube-api-access-xdjcm\") pod \"service-ca-79f68b9f4f-pttqx\" (UID: \"eb57943c-ecbc-42cd-8bb1-9439b78a1801\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.699318 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.699228    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx"
Jul 09 18:05:32.844707 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:32.844677    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pttqx"]
Jul 09 18:05:32.848512 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:05:32.848485    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb57943c_ecbc_42cd_8bb1_9439b78a1801.slice/crio-255b720b652de445432032a6e616bfb8818cf7b408f94784e8394d8f8ae18881 WatchSource:0}: Error finding container 255b720b652de445432032a6e616bfb8818cf7b408f94784e8394d8f8ae18881: Status 404 returned error can't find the container with id 255b720b652de445432032a6e616bfb8818cf7b408f94784e8394d8f8ae18881
Jul 09 18:05:33.334846 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:33.334803    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:33.335022 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:33.334871    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:33.335022 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:33.334949    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:05:33.335022 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:33.334975    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:33.335161 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:33.335037    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:37.335021087 +0000 UTC m=+58.834077817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : configmap "kube-rbac-proxy" not found
Jul 09 18:05:33.335161 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:33.335072    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:37.335048533 +0000 UTC m=+58.834105258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:33.405878 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:33.405843    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx" event={"ID":"eb57943c-ecbc-42cd-8bb1-9439b78a1801","Type":"ContainerStarted","Data":"255b720b652de445432032a6e616bfb8818cf7b408f94784e8394d8f8ae18881"}
Jul 09 18:05:33.576235 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:33.576207    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mx7g4_e3f6f546-6c19-4bd6-89f6-5b049cad7bde/node-ca/0.log"
Jul 09 18:05:34.373411 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:34.373383    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tx2nj_33409e0d-4142-4dbe-abab-eb283eee9edc/serve-healthcheck-canary/0.log"
Jul 09 18:05:36.414997 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:36.414967    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx" event={"ID":"eb57943c-ecbc-42cd-8bb1-9439b78a1801","Type":"ContainerStarted","Data":"f278b7cb8663539c6c948d5520320bbc06050ba2a7d6b8be4d89e8e9d40eccc2"}
Jul 09 18:05:36.433389 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:36.433341    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-pttqx" podStartSLOduration=1.418384303 podStartE2EDuration="4.433325829s" totalImagesPullingTime="3.014941526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:36.43203781 +0000 UTC m=+57.931094558" watchObservedRunningTime="2026-07-09 18:05:36.433325829 +0000 UTC m=+57.932382577"
Jul 09 18:05:37.365812 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:37.365779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:37.366020 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:37.365887    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:37.366020 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:37.365906    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:05:37.366020 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:37.365986    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:45.365965075 +0000 UTC m=+66.865021803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : configmap "kube-rbac-proxy" not found
Jul 09 18:05:37.366020 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:37.366011    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:37.366255 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:37.366090    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:45.366048878 +0000 UTC m=+66.865105623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:40.351919 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:40.351887    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhbzn"
Jul 09 18:05:44.824520 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.824474    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:44.824948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.824528    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:44.824948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.824632    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:44.827398 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.827374    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:05:44.827491 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.827468    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:05:44.828647 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.828630    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:05:44.836996 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.836960    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8ab92ab-b3bb-4440-a0a2-39c193c64a15-original-pull-secret\") pod \"global-pull-secret-syncer-pszsp\" (UID: \"d8ab92ab-b3bb-4440-a0a2-39c193c64a15\") " pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:44.837152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.837020    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf7e722-8a18-4a9c-9a03-b8033505fc4e-metrics-certs\") pod \"network-metrics-daemon-msmqp\" (UID: \"bcf7e722-8a18-4a9c-9a03-b8033505fc4e\") " pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:44.838585 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.838564    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:05:44.847403 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.847372    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7qgf\" (UniqueName: \"kubernetes.io/projected/e74513ee-2955-47cf-9ae4-5f4f7b911bde-kube-api-access-c7qgf\") pod \"network-check-target-jr4r4\" (UID: \"e74513ee-2955-47cf-9ae4-5f4f7b911bde\") " pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:44.931556 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.931526    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vhwtc\""
Jul 09 18:05:44.934019 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.933998    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pszsp"
Jul 09 18:05:44.938909 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:44.938880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-msmqp"
Jul 09 18:05:45.030824 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.030413    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vcghf\""
Jul 09 18:05:45.037465 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.037419    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:45.089646 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.089452    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-msmqp"]
Jul 09 18:05:45.104397 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.103710    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pszsp"]
Jul 09 18:05:45.191913 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.191876    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jr4r4"]
Jul 09 18:05:45.197484 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:05:45.197344    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74513ee_2955_47cf_9ae4_5f4f7b911bde.slice/crio-72dad4fd9070c3f7595bec77e7fb27b4082b49e1caca573ef64e5c4ab034ccc2 WatchSource:0}: Error finding container 72dad4fd9070c3f7595bec77e7fb27b4082b49e1caca573ef64e5c4ab034ccc2: Status 404 returned error can't find the container with id 72dad4fd9070c3f7595bec77e7fb27b4082b49e1caca573ef64e5c4ab034ccc2
Jul 09 18:05:45.431521 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.431426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:45.431521 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.431511    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:45.431819 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:45.431646    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:45.431819 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:45.431724    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls podName:6859cd39-155a-4995-8555-ca166ee428f3 nodeName:}" failed. No retries permitted until 2026-07-09 18:06:01.431703505 +0000 UTC m=+82.930760244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hm7gs" (UID: "6859cd39-155a-4995-8555-ca166ee428f3") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:05:45.432021 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.431995    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6859cd39-155a-4995-8555-ca166ee428f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:05:45.441124 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.441089    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-msmqp" event={"ID":"bcf7e722-8a18-4a9c-9a03-b8033505fc4e","Type":"ContainerStarted","Data":"e5b71ea97228eb71bdda77b728bd37b107999eb3a10008022fac88e679265831"}
Jul 09 18:05:45.442491 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.442459    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jr4r4" event={"ID":"e74513ee-2955-47cf-9ae4-5f4f7b911bde","Type":"ContainerStarted","Data":"72dad4fd9070c3f7595bec77e7fb27b4082b49e1caca573ef64e5c4ab034ccc2"}
Jul 09 18:05:45.443594 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:45.443571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pszsp" event={"ID":"d8ab92ab-b3bb-4440-a0a2-39c193c64a15","Type":"ContainerStarted","Data":"2c5c305f060edcfec27c54edd894075177ea08b8d40cc86ee6c2e7006fe7d72b"}
Jul 09 18:05:47.350279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:47.350242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:47.350844 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:47.350301    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:47.353197 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:47.353137    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0acb8592-4eba-439a-97fc-189710a23316-metrics-tls\") pod \"dns-default-x9lzn\" (UID: \"0acb8592-4eba-439a-97fc-189710a23316\") " pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:47.353314 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:47.353211    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"image-registry-6df5857564-n8gs4\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") " pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:47.550364 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:47.550330    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4mr58\""
Jul 09 18:05:47.557426 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:47.557394    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:47.576587 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:47.576558    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nq7m5\""
Jul 09 18:05:47.584469 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:47.584362    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:50.128745 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.128204    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9lzn"]
Jul 09 18:05:50.151507 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.150074    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df5857564-n8gs4"]
Jul 09 18:05:50.460734 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.460637    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-msmqp" event={"ID":"bcf7e722-8a18-4a9c-9a03-b8033505fc4e","Type":"ContainerStarted","Data":"21d109bd7365f34ce14eb5bf03f6a67411ed25dda611307a950e699acbdde240"}
Jul 09 18:05:50.460734 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.460695    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-msmqp" event={"ID":"bcf7e722-8a18-4a9c-9a03-b8033505fc4e","Type":"ContainerStarted","Data":"83eec0f9af96cd2499edf0fec3f0cb7986361e3692899cce94674bde69a78744"}
Jul 09 18:05:50.462192 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.462161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jr4r4" event={"ID":"e74513ee-2955-47cf-9ae4-5f4f7b911bde","Type":"ContainerStarted","Data":"8b1d3ccd561691fb05afb3d2fa47b44cdbdb99b51856fdc85ca43cc9ca432f56"}
Jul 09 18:05:50.462325 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.462227    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:05:50.467824 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.467791    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pszsp" event={"ID":"d8ab92ab-b3bb-4440-a0a2-39c193c64a15","Type":"ContainerStarted","Data":"ba4e80ce134aa56d311183e0f71b1153cd5ae32e2d13a9dfd18a763dee368149"}
Jul 09 18:05:50.468840 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.468816    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9lzn" event={"ID":"0acb8592-4eba-439a-97fc-189710a23316","Type":"ContainerStarted","Data":"c00ad2577aef5703abcdb7463e4e4d41a8ae414651d5232a9f21e7d1164755ab"}
Jul 09 18:05:50.470100 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.470077    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df5857564-n8gs4" event={"ID":"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6","Type":"ContainerStarted","Data":"9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2"}
Jul 09 18:05:50.470174 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.470116    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df5857564-n8gs4" event={"ID":"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6","Type":"ContainerStarted","Data":"bbc61ab74918e9898fe278743ee74ab4fc9cc6ee95601020d23864215bc48f11"}
Jul 09 18:05:50.470174 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.470157    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:05:50.482124 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.482046    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-msmqp" podStartSLOduration=66.618026514 podStartE2EDuration="1m11.482027066s" totalImagesPullingTime="4.864000552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:50.481448332 +0000 UTC m=+71.980505079" watchObservedRunningTime="2026-07-09 18:05:50.482027066 +0000 UTC m=+71.981083814"
Jul 09 18:05:50.503912 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.503851    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6df5857564-n8gs4" podStartSLOduration=56.503825424 podStartE2EDuration="56.503825424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:50.502600042 +0000 UTC m=+72.001656790" watchObservedRunningTime="2026-07-09 18:05:50.503825424 +0000 UTC m=+72.002882171"
Jul 09 18:05:50.520593 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.520537    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jr4r4" podStartSLOduration=66.754534028 podStartE2EDuration="1m11.52051853s" totalImagesPullingTime="4.765984502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:50.520337875 +0000 UTC m=+72.019394626" watchObservedRunningTime="2026-07-09 18:05:50.52051853 +0000 UTC m=+72.019575277"
Jul 09 18:05:50.537748 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:50.537683    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pszsp" podStartSLOduration=66.675014613 podStartE2EDuration="1m11.537661428s" totalImagesPullingTime="4.862646815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:50.536497765 +0000 UTC m=+72.035554507" watchObservedRunningTime="2026-07-09 18:05:50.537661428 +0000 UTC m=+72.036718178"
Jul 09 18:05:52.478439 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:52.478401    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9lzn" event={"ID":"0acb8592-4eba-439a-97fc-189710a23316","Type":"ContainerStarted","Data":"4b1a2736e8bc12f18f4fa17e0609e969efa9ede29ad6ec742ea571f1add51436"}
Jul 09 18:05:52.478822 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:52.478463    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9lzn" event={"ID":"0acb8592-4eba-439a-97fc-189710a23316","Type":"ContainerStarted","Data":"83bb35aa79c8dfba6a94f810faf23470d6b1a619523ec6a63fd22068f3c34afe"}
Jul 09 18:05:52.478822 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:52.478543    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:05:52.497978 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:52.497927    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x9lzn" podStartSLOduration=35.837252936 podStartE2EDuration="37.497909789s" totalImagesPullingTime="1.660656853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:52.49751666 +0000 UTC m=+73.996573409" watchObservedRunningTime="2026-07-09 18:05:52.497909789 +0000 UTC m=+73.996966537"
Jul 09 18:05:56.055637 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.055596    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7857875887-nxzm8"]
Jul 09 18:05:56.058783 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.058757    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.065403 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.065378    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 18:05:56.065540 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.065379    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 18:05:56.065540 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.065430    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 18:05:56.065663 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.065542    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 18:05:56.068005 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.067989    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 18:05:56.070144 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.070127    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 18:05:56.071814 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.071797    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 18:05:56.073951 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.073931    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df5857564-n8gs4"]
Jul 09 18:05:56.074051 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.073982    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kdcn2\""
Jul 09 18:05:56.089074 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.089017    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7857875887-nxzm8"]
Jul 09 18:05:56.115684 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.115641    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-serving-cert\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.115860 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.115715    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8pzb\" (UniqueName: \"kubernetes.io/projected/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-kube-api-access-b8pzb\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.115860 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.115762    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-oauth-config\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.115860 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.115789    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-service-ca\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.115860 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.115819    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-oauth-serving-cert\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.115860 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.115845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-config\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.216457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.216417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-serving-cert\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.216457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.216455    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8pzb\" (UniqueName: \"kubernetes.io/projected/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-kube-api-access-b8pzb\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.216681 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.216494    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-oauth-config\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.216681 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.216529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-service-ca\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.216681 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.216566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-oauth-serving-cert\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.216681 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.216592    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-config\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.217388 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.217360    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-oauth-serving-cert\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.217522 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.217393    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-service-ca\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.217522 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.217411    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-config\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.218966 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.218945    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-oauth-config\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.219096 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.219014    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-serving-cert\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.226992 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.226956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8pzb\" (UniqueName: \"kubernetes.io/projected/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-kube-api-access-b8pzb\") pod \"console-7857875887-nxzm8\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") " pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.367454 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.367421    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:05:56.499934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:56.499901    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7857875887-nxzm8"]
Jul 09 18:05:56.502867 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:05:56.502841    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a7a144_670f_4b69_aff6_7cdc0ef9a4bb.slice/crio-4f94d6cd0f8b3c0ca10f984be74d957a199e854299499f17340160671317d7ea WatchSource:0}: Error finding container 4f94d6cd0f8b3c0ca10f984be74d957a199e854299499f17340160671317d7ea: Status 404 returned error can't find the container with id 4f94d6cd0f8b3c0ca10f984be74d957a199e854299499f17340160671317d7ea
Jul 09 18:05:57.496716 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:05:57.496680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857875887-nxzm8" event={"ID":"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb","Type":"ContainerStarted","Data":"4f94d6cd0f8b3c0ca10f984be74d957a199e854299499f17340160671317d7ea"}
Jul 09 18:05:58.075554 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:58.075503    2569 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80242aab4213d20dbda98c11c3057bc7ebccdd01e419a1331f767153c40889a8"
Jul 09 18:05:58.075786 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:58.075636    2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container console start failed in pod console-7857875887-nxzm8_openshift-console(25a7a144-670f-4b69-aff6-7cdc0ef9a4bb): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 09 18:05:58.075786 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:58.075674    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-console/console-7857875887-nxzm8" podUID="25a7a144-670f-4b69-aff6-7cdc0ef9a4bb"
Jul 09 18:05:58.501498 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:05:58.501465    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80242aab4213d20dbda98c11c3057bc7ebccdd01e419a1331f767153c40889a8\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-console/console-7857875887-nxzm8" podUID="25a7a144-670f-4b69-aff6-7cdc0ef9a4bb"
Jul 09 18:06:01.453091 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:01.452926    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:06:01.455305 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:01.455277    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6859cd39-155a-4995-8555-ca166ee428f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hm7gs\" (UID: \"6859cd39-155a-4995-8555-ca166ee428f3\") " pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:06:01.713538 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:01.713456    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qh478\""
Jul 09 18:06:01.720869 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:01.720841    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hm7gs"
Jul 09 18:06:01.866356 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:01.866333    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hm7gs"]
Jul 09 18:06:01.869345 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:01.869317    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6859cd39_155a_4995_8555_ca166ee428f3.slice/crio-ddc11b83a18d1a9c5f26b2f13e3c665bd2c7390d2c4afda9f9d2e593d231a615 WatchSource:0}: Error finding container ddc11b83a18d1a9c5f26b2f13e3c665bd2c7390d2c4afda9f9d2e593d231a615: Status 404 returned error can't find the container with id ddc11b83a18d1a9c5f26b2f13e3c665bd2c7390d2c4afda9f9d2e593d231a615
Jul 09 18:06:02.485224 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:02.485196    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x9lzn"
Jul 09 18:06:02.516385 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:02.516345    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hm7gs" event={"ID":"6859cd39-155a-4995-8555-ca166ee428f3","Type":"ContainerStarted","Data":"ddc11b83a18d1a9c5f26b2f13e3c665bd2c7390d2c4afda9f9d2e593d231a615"}
Jul 09 18:06:06.080456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:06.080420    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:06:07.534831 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:07.534746    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hm7gs" event={"ID":"6859cd39-155a-4995-8555-ca166ee428f3","Type":"ContainerStarted","Data":"dc35c5e53216fed7ce0d9d8e417dcc054cc14318609d03b83d3aa2b8e6b197e6"}
Jul 09 18:06:08.540791 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:08.540749    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hm7gs" event={"ID":"6859cd39-155a-4995-8555-ca166ee428f3","Type":"ContainerStarted","Data":"36eda954853e00b36b460f4c9bdb0c0a672c29f8f0e0c372508baf0dd341842d"}
Jul 09 18:06:10.551884 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:10.551846    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hm7gs" event={"ID":"6859cd39-155a-4995-8555-ca166ee428f3","Type":"ContainerStarted","Data":"ff42322bc5dc3c90761699a309654b22e77df5b884f01326b2cffed662f2a700"}
Jul 09 18:06:10.573985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:10.573929    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hm7gs" podStartSLOduration=33.226324251 podStartE2EDuration="41.573912823s" totalImagesPullingTime="8.347588572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:10.57191217 +0000 UTC m=+92.070968918" watchObservedRunningTime="2026-07-09 18:06:10.573912823 +0000 UTC m=+92.072969570"
Jul 09 18:06:13.564491 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:13.564458    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857875887-nxzm8" event={"ID":"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb","Type":"ContainerStarted","Data":"7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968"}
Jul 09 18:06:13.584916 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:13.584864    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7857875887-nxzm8" podStartSLOduration=1.203772867 podStartE2EDuration="17.584846814s" totalImagesPullingTime="16.381073947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-09 18:06:13.584386932 +0000 UTC m=+95.083443678" watchObservedRunningTime="2026-07-09 18:06:13.584846814 +0000 UTC m=+95.083903562"
Jul 09 18:06:16.367909 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:16.367865    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:06:16.368399 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:16.367949    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:06:16.372769 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:16.372746    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:06:16.578268 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:16.578237    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:06:20.248649 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.248606    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"]
Jul 09 18:06:20.252881 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.252858    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"
Jul 09 18:06:20.255625 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.255596    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 18:06:20.255781 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.255627    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fvgwz\""
Jul 09 18:06:20.261323 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.261298    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"]
Jul 09 18:06:20.395070 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.395030    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b03893c-e8e5-493c-a403-356658f5242a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jq4kw\" (UID: \"5b03893c-e8e5-493c-a403-356658f5242a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"
Jul 09 18:06:20.495804 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.495765    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b03893c-e8e5-493c-a403-356658f5242a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jq4kw\" (UID: \"5b03893c-e8e5-493c-a403-356658f5242a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"
Jul 09 18:06:20.498242 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.498214    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b03893c-e8e5-493c-a403-356658f5242a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jq4kw\" (UID: \"5b03893c-e8e5-493c-a403-356658f5242a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"
Jul 09 18:06:20.562309 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.562224    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"
Jul 09 18:06:20.700755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:20.700721    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"]
Jul 09 18:06:20.704103 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:20.703971    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b03893c_e8e5_493c_a403_356658f5242a.slice/crio-e36527bdafbae83e2e34d6f125a119370d0b4e29b714d43d6376b9991cd4f76e WatchSource:0}: Error finding container e36527bdafbae83e2e34d6f125a119370d0b4e29b714d43d6376b9991cd4f76e: Status 404 returned error can't find the container with id e36527bdafbae83e2e34d6f125a119370d0b4e29b714d43d6376b9991cd4f76e
Jul 09 18:06:21.095046 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.094982    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6df5857564-n8gs4" podUID="cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" containerName="registry" containerID="cri-o://9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2" gracePeriod=30
Jul 09 18:06:21.365391 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.365316    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:06:21.475735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.475704    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jr4r4"
Jul 09 18:06:21.504098 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.503541    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") pod \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") "
Jul 09 18:06:21.504098 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.503588    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4sr2\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-kube-api-access-c4sr2\") pod \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") "
Jul 09 18:06:21.504098 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.503617    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-trusted-ca\") pod \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") "
Jul 09 18:06:21.504098 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.503640    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-bound-sa-token\") pod \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") "
Jul 09 18:06:21.504098 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.503667    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-installation-pull-secrets\") pod \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") "
Jul 09 18:06:21.504098 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.503717    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-certificates\") pod \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") "
Jul 09 18:06:21.504098 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.503758    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-image-registry-private-configuration\") pod \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") "
Jul 09 18:06:21.504098 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.503798    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-ca-trust-extracted\") pod \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\" (UID: \"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6\") "
Jul 09 18:06:21.504601 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.504517    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:06:21.505085 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.504973    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:06:21.507264 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.507204    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:06:21.508650 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.508612    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:06:21.509489 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.509216    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-kube-api-access-c4sr2" (OuterVolumeSpecName: "kube-api-access-c4sr2") pod "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6"). InnerVolumeSpecName "kube-api-access-c4sr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:06:21.509489 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.509314    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:06:21.509489 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.509460    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:06:21.516372 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.516288    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" (UID: "cd74ba77-ad4e-4f1c-85c3-9505da42b9b6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:21.594405 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.594359    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw" event={"ID":"5b03893c-e8e5-493c-a403-356658f5242a","Type":"ContainerStarted","Data":"e36527bdafbae83e2e34d6f125a119370d0b4e29b714d43d6376b9991cd4f76e"}
Jul 09 18:06:21.595884 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.595851    2569 generic.go:356] "Generic (PLEG): container finished" podID="cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" containerID="9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2" exitCode=0
Jul 09 18:06:21.596049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.595905    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df5857564-n8gs4" event={"ID":"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6","Type":"ContainerDied","Data":"9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2"}
Jul 09 18:06:21.596049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.595944    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df5857564-n8gs4" event={"ID":"cd74ba77-ad4e-4f1c-85c3-9505da42b9b6","Type":"ContainerDied","Data":"bbc61ab74918e9898fe278743ee74ab4fc9cc6ee95601020d23864215bc48f11"}
Jul 09 18:06:21.596049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.595910    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df5857564-n8gs4"
Jul 09 18:06:21.596049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.595989    2569 scope.go:117] "RemoveContainer" containerID="9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2"
Jul 09 18:06:21.604796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.604627    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-ca-trust-extracted\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:21.604796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.604656    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-tls\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:21.604796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.604672    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4sr2\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-kube-api-access-c4sr2\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:21.604796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.604685    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-trusted-ca\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:21.604796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.604700    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-bound-sa-token\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:21.604796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.604713    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-installation-pull-secrets\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:21.604796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.604726    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-registry-certificates\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:21.604796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.604742    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6-image-registry-private-configuration\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:21.606208 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.606185    2569 scope.go:117] "RemoveContainer" containerID="9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2"
Jul 09 18:06:21.606641 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:06:21.606612    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2\": container with ID starting with 9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2 not found: ID does not exist" containerID="9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2"
Jul 09 18:06:21.606724 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.606651    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2"} err="failed to get container status \"9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2\": rpc error: code = NotFound desc = could not find container \"9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2\": container with ID starting with 9c5622451821d79810f7dcf1a01d3151892f82103fe2929efb2483a23a1432e2 not found: ID does not exist"
Jul 09 18:06:21.622140 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.622049    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df5857564-n8gs4"]
Jul 09 18:06:21.626705 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:21.626671    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6df5857564-n8gs4"]
Jul 09 18:06:23.120179 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:23.120149    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" path="/var/lib/kubelet/pods/cd74ba77-ad4e-4f1c-85c3-9505da42b9b6/volumes"
Jul 09 18:06:23.605315 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:23.605283    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw" event={"ID":"5b03893c-e8e5-493c-a403-356658f5242a","Type":"ContainerStarted","Data":"7b9578f7479e08bcf5c0f2f981e8bfe8476b066c15518d26c26db54aa90d971a"}
Jul 09 18:06:23.605563 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:23.605542    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"
Jul 09 18:06:23.610259 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:23.610238    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw"
Jul 09 18:06:23.624538 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:23.624473    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jq4kw" podStartSLOduration=1.756692594 podStartE2EDuration="3.624452577s" totalImagesPullingTime="1.867759983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:23.623246131 +0000 UTC m=+105.122302880" watchObservedRunningTime="2026-07-09 18:06:23.624452577 +0000 UTC m=+105.123509325"
Jul 09 18:06:24.413572 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.413534    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-sbpjx"]
Jul 09 18:06:24.413938 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.413768    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" containerName="registry"
Jul 09 18:06:24.413938 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.413778    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" containerName="registry"
Jul 09 18:06:24.413938 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.413828    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd74ba77-ad4e-4f1c-85c3-9505da42b9b6" containerName="registry"
Jul 09 18:06:24.436267 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.436225    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7857875887-nxzm8"]
Jul 09 18:06:24.436267 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.436273    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-sbpjx"]
Jul 09 18:06:24.436458 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.436415    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.441972 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.441946    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 18:06:24.442693 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.442476    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lgrrp\""
Jul 09 18:06:24.442693 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.442530    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 18:06:24.442693 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.442547    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 18:06:24.442693 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.442536    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 18:06:24.443577 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.443561    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 18:06:24.525744 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.525707    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4769445-44d5-4fdf-9411-c040580bc87b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.525744 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.525752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4769445-44d5-4fdf-9411-c040580bc87b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.525963 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.525775    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdd6n\" (UniqueName: \"kubernetes.io/projected/e4769445-44d5-4fdf-9411-c040580bc87b-kube-api-access-wdd6n\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.525963 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.525854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4769445-44d5-4fdf-9411-c040580bc87b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.626302 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.626269    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4769445-44d5-4fdf-9411-c040580bc87b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.626514 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.626338    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4769445-44d5-4fdf-9411-c040580bc87b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.626586 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.626506    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4769445-44d5-4fdf-9411-c040580bc87b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.626586 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.626544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdd6n\" (UniqueName: \"kubernetes.io/projected/e4769445-44d5-4fdf-9411-c040580bc87b-kube-api-access-wdd6n\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.627084 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.627039    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4769445-44d5-4fdf-9411-c040580bc87b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.628776 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.628752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4769445-44d5-4fdf-9411-c040580bc87b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.628868 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.628820    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4769445-44d5-4fdf-9411-c040580bc87b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.637963 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.637940    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdd6n\" (UniqueName: \"kubernetes.io/projected/e4769445-44d5-4fdf-9411-c040580bc87b-kube-api-access-wdd6n\") pod \"prometheus-operator-64785b6675-sbpjx\" (UID: \"e4769445-44d5-4fdf-9411-c040580bc87b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.748277 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.748189    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx"
Jul 09 18:06:24.914029 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:24.913997    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-sbpjx"]
Jul 09 18:06:24.916888 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:24.916859    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4769445_44d5_4fdf_9411_c040580bc87b.slice/crio-f5ee2496b4ac0c7468bab6851603722801c15bab44605d39f3611059e9884707 WatchSource:0}: Error finding container f5ee2496b4ac0c7468bab6851603722801c15bab44605d39f3611059e9884707: Status 404 returned error can't find the container with id f5ee2496b4ac0c7468bab6851603722801c15bab44605d39f3611059e9884707
Jul 09 18:06:25.613804 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:25.613767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx" event={"ID":"e4769445-44d5-4fdf-9411-c040580bc87b","Type":"ContainerStarted","Data":"f5ee2496b4ac0c7468bab6851603722801c15bab44605d39f3611059e9884707"}
Jul 09 18:06:26.618387 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:26.618352    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx" event={"ID":"e4769445-44d5-4fdf-9411-c040580bc87b","Type":"ContainerStarted","Data":"498376b91f7b0a738860b8949e3d1ac8ab33eef6cbe4eab0c9675cfb22dc0039"}
Jul 09 18:06:26.618929 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:26.618404    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx" event={"ID":"e4769445-44d5-4fdf-9411-c040580bc87b","Type":"ContainerStarted","Data":"9c14d0c200d1ac29f03e510d1d0c9ad4e95e56d89986a95c43652614935160f0"}
Jul 09 18:06:28.768269 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.768198    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-sbpjx" podStartSLOduration=3.718144889 podStartE2EDuration="4.768179531s" totalImagesPullingTime="1.050034642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:26.638877594 +0000 UTC m=+108.137934343" watchObservedRunningTime="2026-07-09 18:06:28.768179531 +0000 UTC m=+110.267236277"
Jul 09 18:06:28.769195 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.769169    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"]
Jul 09 18:06:28.771813 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.771790    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.774734 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.774708    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 18:06:28.774901 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.774873    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 18:06:28.774974 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.774890    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dwr4f\""
Jul 09 18:06:28.786782 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.786752    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"]
Jul 09 18:06:28.865222 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.865185    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/460e28c1-334c-4166-b027-6e2e0a36ab12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.865439 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.865229    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdg9f\" (UniqueName: \"kubernetes.io/projected/460e28c1-334c-4166-b027-6e2e0a36ab12-kube-api-access-tdg9f\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.865439 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.865339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460e28c1-334c-4166-b027-6e2e0a36ab12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.865439 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.865373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/460e28c1-334c-4166-b027-6e2e0a36ab12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.875706 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.875677    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jmts9"]
Jul 09 18:06:28.877890 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.877872    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.880622 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.880600    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hpgbg\""
Jul 09 18:06:28.881563 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.881542    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 18:06:28.881687 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.881543    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 18:06:28.881851 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.881834    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 18:06:28.965953 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.965917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.966193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.965968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/460e28c1-334c-4166-b027-6e2e0a36ab12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.966193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.965993    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-textfile\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.966193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r64fj\" (UniqueName: \"kubernetes.io/projected/10fbd32c-45c3-4550-9e55-434964c2abb1-kube-api-access-r64fj\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.966193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966046    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-sys\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.966193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdg9f\" (UniqueName: \"kubernetes.io/projected/460e28c1-334c-4166-b027-6e2e0a36ab12-kube-api-access-tdg9f\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.966193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-root\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.966193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966161    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fbd32c-45c3-4550-9e55-434964c2abb1-metrics-client-ca\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.966193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.966593 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966209    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460e28c1-334c-4166-b027-6e2e0a36ab12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.966593 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/460e28c1-334c-4166-b027-6e2e0a36ab12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.966593 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966277    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-tls\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.966593 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.966325    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-wtmp\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:28.967191 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.967164    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460e28c1-334c-4166-b027-6e2e0a36ab12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.968863 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.968833    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/460e28c1-334c-4166-b027-6e2e0a36ab12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.969329 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.969306    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/460e28c1-334c-4166-b027-6e2e0a36ab12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:28.975319 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:28.975297    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdg9f\" (UniqueName: \"kubernetes.io/projected/460e28c1-334c-4166-b027-6e2e0a36ab12-kube-api-access-tdg9f\") pod \"openshift-state-metrics-84bd68b896-wdxbc\" (UID: \"460e28c1-334c-4166-b027-6e2e0a36ab12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:29.067734 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-root\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.067734 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fbd32c-45c3-4550-9e55-434964c2abb1-metrics-client-ca\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.067936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067757    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-root\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.067936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067810    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.067936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067867    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-tls\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.067936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067891    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-wtmp\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.067936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067915    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.068187 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067958    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-textfile\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.068187 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.067983    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r64fj\" (UniqueName: \"kubernetes.io/projected/10fbd32c-45c3-4550-9e55-434964c2abb1-kube-api-access-r64fj\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.068187 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.068009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-sys\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.068396 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.068370    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fbd32c-45c3-4550-9e55-434964c2abb1-metrics-client-ca\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.068489 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.068408    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-sys\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.068489 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.068404    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-wtmp\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.068489 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.068377    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-textfile\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.068602 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.068536    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.070542 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.070518    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-tls\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.070754 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.070736    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10fbd32c-45c3-4550-9e55-434964c2abb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.077130 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.077101    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r64fj\" (UniqueName: \"kubernetes.io/projected/10fbd32c-45c3-4550-9e55-434964c2abb1-kube-api-access-r64fj\") pod \"node-exporter-jmts9\" (UID: \"10fbd32c-45c3-4550-9e55-434964c2abb1\") " pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.081997 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.081973    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"
Jul 09 18:06:29.188166 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.187466    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jmts9"
Jul 09 18:06:29.199710 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:29.199673    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fbd32c_45c3_4550_9e55_434964c2abb1.slice/crio-5bd5d1367a520502bad23f610d0d3239b633f5024a441d4d19d4d061a4024b63 WatchSource:0}: Error finding container 5bd5d1367a520502bad23f610d0d3239b633f5024a441d4d19d4d061a4024b63: Status 404 returned error can't find the container with id 5bd5d1367a520502bad23f610d0d3239b633f5024a441d4d19d4d061a4024b63
Jul 09 18:06:29.230041 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.230012    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc"]
Jul 09 18:06:29.233221 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:29.233195    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460e28c1_334c_4166_b027_6e2e0a36ab12.slice/crio-70802897e3d33e4c465f22d759be40e6e1ce6053ce693f4788816e2a12cd0919 WatchSource:0}: Error finding container 70802897e3d33e4c465f22d759be40e6e1ce6053ce693f4788816e2a12cd0919: Status 404 returned error can't find the container with id 70802897e3d33e4c465f22d759be40e6e1ce6053ce693f4788816e2a12cd0919
Jul 09 18:06:29.630134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.630027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jmts9" event={"ID":"10fbd32c-45c3-4550-9e55-434964c2abb1","Type":"ContainerStarted","Data":"5bd5d1367a520502bad23f610d0d3239b633f5024a441d4d19d4d061a4024b63"}
Jul 09 18:06:29.631732 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.631703    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc" event={"ID":"460e28c1-334c-4166-b027-6e2e0a36ab12","Type":"ContainerStarted","Data":"3d2b58f36c8790084fe6dd648627fbd62c0437c874b44d0ca85266256e354a1e"}
Jul 09 18:06:29.631874 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.631757    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc" event={"ID":"460e28c1-334c-4166-b027-6e2e0a36ab12","Type":"ContainerStarted","Data":"5df119f59b047a2a5a0315a3d198192305872cec33013bace3783ecb7e50c06c"}
Jul 09 18:06:29.631874 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.631784    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc" event={"ID":"460e28c1-334c-4166-b027-6e2e0a36ab12","Type":"ContainerStarted","Data":"70802897e3d33e4c465f22d759be40e6e1ce6053ce693f4788816e2a12cd0919"}
Jul 09 18:06:29.925280 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.925160    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:06:29.933141 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.931981    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:29.935662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.935587    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rfjjp\""
Jul 09 18:06:29.935823 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.935795    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 18:06:29.936018 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.935991    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 18:06:29.936165 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.936068    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 18:06:29.936449 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.936226    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 18:06:29.936449 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.936287    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 18:06:29.936449 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.936323    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 18:06:29.936449 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.936290    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 18:06:29.936706 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.936539    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 18:06:29.937026 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.937009    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 18:06:29.948099 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:29.948076    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:06:30.075889 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.075856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.075889 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.075895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-config-out\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076230 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.075934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076230 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.075964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076230 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.075994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076230 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.076011    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdt8\" (UniqueName: \"kubernetes.io/projected/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-kube-api-access-vcdt8\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076230 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.076031    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076230 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.076137    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076230 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.076169    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-web-config\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076230 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.076209    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076525 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.076238    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076525 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.076277    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.076525 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.076309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.177793 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.177718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.177793 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.177759    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-web-config\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.177793 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.177787    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178048 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.177807    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178048 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.177873    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178048 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.177924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178048 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.177953    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178048 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.177978    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-config-out\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178048 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.178009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.178050    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.178125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.178170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdt8\" (UniqueName: \"kubernetes.io/projected/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-kube-api-access-vcdt8\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.178217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178984 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.178939    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.178984 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.178975    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.180626 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.180602    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.180818 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.180794    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.180982 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.180955    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.181523 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.181478    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-config-out\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.183305 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.183244    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.183660 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.183632    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.184008 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.183988    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.184125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.184104    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.185326 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.185307    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.185412 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.185365    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-web-config\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.192314 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.192287    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdt8\" (UniqueName: \"kubernetes.io/projected/3adbbb95-20b9-4b9e-8985-aabd8d9e78f2-kube-api-access-vcdt8\") pod \"alertmanager-main-0\" (UID: \"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.245163 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.245129    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:06:30.521943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.521914    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:06:30.524708 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:30.524664    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adbbb95_20b9_4b9e_8985_aabd8d9e78f2.slice/crio-104dca1e896acd87d9d1b2b80f932cf08a2602311d26cf2cb974b1272e1060b8 WatchSource:0}: Error finding container 104dca1e896acd87d9d1b2b80f932cf08a2602311d26cf2cb974b1272e1060b8: Status 404 returned error can't find the container with id 104dca1e896acd87d9d1b2b80f932cf08a2602311d26cf2cb974b1272e1060b8
Jul 09 18:06:30.637221 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.637183    2569 generic.go:356] "Generic (PLEG): container finished" podID="10fbd32c-45c3-4550-9e55-434964c2abb1" containerID="943df94fca413bf5b4042139a567b4639e88305b2592ee9b5e363301f2e74227" exitCode=0
Jul 09 18:06:30.637421 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.637278    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jmts9" event={"ID":"10fbd32c-45c3-4550-9e55-434964c2abb1","Type":"ContainerDied","Data":"943df94fca413bf5b4042139a567b4639e88305b2592ee9b5e363301f2e74227"}
Jul 09 18:06:30.638614 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.638591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2","Type":"ContainerStarted","Data":"104dca1e896acd87d9d1b2b80f932cf08a2602311d26cf2cb974b1272e1060b8"}
Jul 09 18:06:30.892195 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.892160    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"]
Jul 09 18:06:30.894661 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.894643    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:30.897506 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.897481    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 18:06:30.897825 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.897638    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-crdc8\""
Jul 09 18:06:30.897825 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.897638    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 18:06:30.897825 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.897711    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 18:06:30.898049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.897911    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-88e795r6c22ue\""
Jul 09 18:06:30.898049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.897990    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 18:06:30.898373 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.898355    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 18:06:30.909286 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.909261    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"]
Jul 09 18:06:30.983822 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.983733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:30.983822 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.983769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-tls\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:30.984279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.983843    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:30.984279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.983880    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:30.984279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.983916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:30.984279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.983950    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h66nq\" (UniqueName: \"kubernetes.io/projected/7bd9446a-9e90-4bab-b656-a39d994d30a3-kube-api-access-h66nq\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:30.984279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.984016    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bd9446a-9e90-4bab-b656-a39d994d30a3-metrics-client-ca\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:30.984279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:30.984096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-grpc-tls\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.085423 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.085390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.085635 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.085448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.085635 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.085483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.085635 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.085529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h66nq\" (UniqueName: \"kubernetes.io/projected/7bd9446a-9e90-4bab-b656-a39d994d30a3-kube-api-access-h66nq\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.085635 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.085564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bd9446a-9e90-4bab-b656-a39d994d30a3-metrics-client-ca\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.085635 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.085594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-grpc-tls\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.085635 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.085619    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.085947 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.085645    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-tls\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.086558 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.086393    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bd9446a-9e90-4bab-b656-a39d994d30a3-metrics-client-ca\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.088763 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.088741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.089007 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.088981    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-grpc-tls\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.089378 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.089353    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.089483 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.089452    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.089619 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.089590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-tls\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.091222 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.091196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7bd9446a-9e90-4bab-b656-a39d994d30a3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.094835 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.094814    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h66nq\" (UniqueName: \"kubernetes.io/projected/7bd9446a-9e90-4bab-b656-a39d994d30a3-kube-api-access-h66nq\") pod \"thanos-querier-5d7d9f746d-7rmgc\" (UID: \"7bd9446a-9e90-4bab-b656-a39d994d30a3\") " pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.204944 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.204905    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:31.353273 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.353084    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"]
Jul 09 18:06:31.355796 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:31.355764    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd9446a_9e90_4bab_b656_a39d994d30a3.slice/crio-7d4ff445d548e7ff476c9839427d2be6c7e149c93eeaa8030e9911d046a944ea WatchSource:0}: Error finding container 7d4ff445d548e7ff476c9839427d2be6c7e149c93eeaa8030e9911d046a944ea: Status 404 returned error can't find the container with id 7d4ff445d548e7ff476c9839427d2be6c7e149c93eeaa8030e9911d046a944ea
Jul 09 18:06:31.644962 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.644914    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jmts9" event={"ID":"10fbd32c-45c3-4550-9e55-434964c2abb1","Type":"ContainerStarted","Data":"fe21e04dcb35303628c782660eda3fada2f9cae842a1bc3d8db5b44cadd3f295"}
Jul 09 18:06:31.645178 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.644999    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jmts9" event={"ID":"10fbd32c-45c3-4550-9e55-434964c2abb1","Type":"ContainerStarted","Data":"0ef73055a5e7e719ae1411c495d2a4bb44e5859d71805ee7285f987e8a88d79b"}
Jul 09 18:06:31.646292 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.646265    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc" event={"ID":"7bd9446a-9e90-4bab-b656-a39d994d30a3","Type":"ContainerStarted","Data":"7d4ff445d548e7ff476c9839427d2be6c7e149c93eeaa8030e9911d046a944ea"}
Jul 09 18:06:31.669143 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:31.669092    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jmts9" podStartSLOduration=2.392235498 podStartE2EDuration="3.669073903s" totalImagesPullingTime="1.205936279s" totalInitContainerRuntime="70.902126ms" isStatefulPod=true podCreationTimestamp="2026-07-09 18:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:31.667362247 +0000 UTC m=+113.166418994" watchObservedRunningTime="2026-07-09 18:06:31.669073903 +0000 UTC m=+113.168130641"
Jul 09 18:06:32.652082 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:32.652024    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc" event={"ID":"460e28c1-334c-4166-b027-6e2e0a36ab12","Type":"ContainerStarted","Data":"54728e5994a9a0e598a461b55b058ae9b0c9f6c2996e96e80cb682d75ec0f67e"}
Jul 09 18:06:32.653533 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:32.653506    2569 generic.go:356] "Generic (PLEG): container finished" podID="3adbbb95-20b9-4b9e-8985-aabd8d9e78f2" containerID="e8b965bb672702b593db39bf2b5088577c21e048ad4b460311df80d391722522" exitCode=0
Jul 09 18:06:32.653648 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:32.653589    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2","Type":"ContainerDied","Data":"e8b965bb672702b593db39bf2b5088577c21e048ad4b460311df80d391722522"}
Jul 09 18:06:32.671817 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:32.671771    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-wdxbc" podStartSLOduration=1.6012016359999999 podStartE2EDuration="4.671756937s" totalImagesPullingTime="3.070555301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:32.670372108 +0000 UTC m=+114.169428870" watchObservedRunningTime="2026-07-09 18:06:32.671756937 +0000 UTC m=+114.170813685"
Jul 09 18:06:33.069150 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.069110    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55df8d4f4b-xmg75"]
Jul 09 18:06:33.071786 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.071763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.075281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.075249    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 18:06:33.075281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.075266    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3q413ntlmadto\""
Jul 09 18:06:33.075281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.075276    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 18:06:33.075540 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.075249    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 18:06:33.075540 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.075391    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rdmw7\""
Jul 09 18:06:33.075540 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.075253    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 18:06:33.081144 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.081121    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55df8d4f4b-xmg75"]
Jul 09 18:06:33.203304 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.203268    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.203304 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.203311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-metrics-server-audit-profiles\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.203572 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.203346    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-audit-log\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.203572 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.203363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdphr\" (UniqueName: \"kubernetes.io/projected/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-kube-api-access-gdphr\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.203572 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.203452    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-secret-metrics-server-tls\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.203572 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.203488    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-secret-metrics-server-client-certs\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.203572 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.203547    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-client-ca-bundle\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.304726 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.304691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-secret-metrics-server-tls\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.304934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.304736    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-secret-metrics-server-client-certs\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.304934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.304779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-client-ca-bundle\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.304934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.304831    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.304934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.304856    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-metrics-server-audit-profiles\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.304934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.304904    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-audit-log\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.304934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.304933    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdphr\" (UniqueName: \"kubernetes.io/projected/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-kube-api-access-gdphr\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.305728 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.305689    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-audit-log\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.305869 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.305819    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.306222 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.306196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-metrics-server-audit-profiles\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.308015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.307995    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-secret-metrics-server-tls\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.308210 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.308186    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-secret-metrics-server-client-certs\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.308210 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.308199    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-client-ca-bundle\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.314506 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.314479    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdphr\" (UniqueName: \"kubernetes.io/projected/14ea66fb-ecd1-4b41-959a-46a6d852b5d5-kube-api-access-gdphr\") pod \"metrics-server-55df8d4f4b-xmg75\" (UID: \"14ea66fb-ecd1-4b41-959a-46a6d852b5d5\") " pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.381490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.381386    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:33.538332 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.538290    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55df8d4f4b-xmg75"]
Jul 09 18:06:33.539340 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.539315    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-87bd55f4f-92869"]
Jul 09 18:06:33.540384 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:33.540348    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ea66fb_ecd1_4b41_959a_46a6d852b5d5.slice/crio-9700bfadadcdcb265f363122434e577359d3626d0e0f912366ded24041fb71e8 WatchSource:0}: Error finding container 9700bfadadcdcb265f363122434e577359d3626d0e0f912366ded24041fb71e8: Status 404 returned error can't find the container with id 9700bfadadcdcb265f363122434e577359d3626d0e0f912366ded24041fb71e8
Jul 09 18:06:33.542400 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.542380    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.550642 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.550618    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 18:06:33.553277 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.553248    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87bd55f4f-92869"]
Jul 09 18:06:33.659625 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.659539    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75" event={"ID":"14ea66fb-ecd1-4b41-959a-46a6d852b5d5","Type":"ContainerStarted","Data":"9700bfadadcdcb265f363122434e577359d3626d0e0f912366ded24041fb71e8"}
Jul 09 18:06:33.707811 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.707773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-service-ca\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.707811 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.707818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-oauth-config\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.708125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.707838    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-trusted-ca-bundle\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.708125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.707856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-serving-cert\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.708125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.707876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-console-config\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.708125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.708026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqg5l\" (UniqueName: \"kubernetes.io/projected/853ec205-00d9-4d53-8621-984fff48b308-kube-api-access-nqg5l\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.708125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.708125    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-oauth-serving-cert\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.809138 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.809096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-console-config\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.809292 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.809166    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqg5l\" (UniqueName: \"kubernetes.io/projected/853ec205-00d9-4d53-8621-984fff48b308-kube-api-access-nqg5l\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.809405 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.809377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-oauth-serving-cert\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.809578 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.809469    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-service-ca\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.809578 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.809500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-oauth-config\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.809578 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.809523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-trusted-ca-bundle\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.809578 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.809555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-serving-cert\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.809955 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.809932    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-console-config\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.810120 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.810098    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-oauth-serving-cert\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.810188 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.810153    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-service-ca\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.810586 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.810560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-trusted-ca-bundle\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.812354 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.812332    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-oauth-config\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.812539 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.812520    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-serving-cert\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.818152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.818122    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqg5l\" (UniqueName: \"kubernetes.io/projected/853ec205-00d9-4d53-8621-984fff48b308-kube-api-access-nqg5l\") pod \"console-87bd55f4f-92869\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") " pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:33.859467 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:33.859422    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:34.019083 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:34.019037    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87bd55f4f-92869"]
Jul 09 18:06:34.021886 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:34.021856    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853ec205_00d9_4d53_8621_984fff48b308.slice/crio-1228c306181f7a962f67855e72f2dc86c5e36e72a3b3d33f8424f3506b187361 WatchSource:0}: Error finding container 1228c306181f7a962f67855e72f2dc86c5e36e72a3b3d33f8424f3506b187361: Status 404 returned error can't find the container with id 1228c306181f7a962f67855e72f2dc86c5e36e72a3b3d33f8424f3506b187361
Jul 09 18:06:34.667051 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:34.666858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87bd55f4f-92869" event={"ID":"853ec205-00d9-4d53-8621-984fff48b308","Type":"ContainerStarted","Data":"c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a"}
Jul 09 18:06:34.667506 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:34.667173    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87bd55f4f-92869" event={"ID":"853ec205-00d9-4d53-8621-984fff48b308","Type":"ContainerStarted","Data":"1228c306181f7a962f67855e72f2dc86c5e36e72a3b3d33f8424f3506b187361"}
Jul 09 18:06:34.669551 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:34.669524    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2","Type":"ContainerStarted","Data":"09f5b77c30951cd871623befc58a7fbb879799c12080d4252e134963eb4a44ca"}
Jul 09 18:06:34.688934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:34.688847    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-87bd55f4f-92869" podStartSLOduration=1.6888220600000001 podStartE2EDuration="1.68882206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:34.687748472 +0000 UTC m=+116.186805220" watchObservedRunningTime="2026-07-09 18:06:34.68882206 +0000 UTC m=+116.187878808"
Jul 09 18:06:35.676302 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:35.676263    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2","Type":"ContainerStarted","Data":"72740ef175914b9e1c67fd225dcb5f425817f891bfd0e05506bb7b3a8f17c36d"}
Jul 09 18:06:36.683746 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:36.683708    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2","Type":"ContainerStarted","Data":"6e01c770580095afcc2a411f61ee2eb263f265de3f9148fdb59c3d0785bb235a"}
Jul 09 18:06:36.684209 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:36.683775    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2","Type":"ContainerStarted","Data":"33e1cef11da26bda9b3d608c06d733868cf91390d0a973dc512b30fc59a0dc8a"}
Jul 09 18:06:36.684209 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:36.683815    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2","Type":"ContainerStarted","Data":"804ee1f9721a1c02dd3196ccd79a0a08d0efc9a6615d762b5e19bd32456cee15"}
Jul 09 18:06:36.685830 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:36.685807    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc" event={"ID":"7bd9446a-9e90-4bab-b656-a39d994d30a3","Type":"ContainerStarted","Data":"c9429f65b3299ea30d9070151a42b3f084a51625d42cbbcb538dd8b84e216c8e"}
Jul 09 18:06:36.685953 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:36.685859    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc" event={"ID":"7bd9446a-9e90-4bab-b656-a39d994d30a3","Type":"ContainerStarted","Data":"ab741742786c7bd96f7310247f20aad42711d1fb6830662e7ab94e821239c31f"}
Jul 09 18:06:36.685953 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:36.685884    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc" event={"ID":"7bd9446a-9e90-4bab-b656-a39d994d30a3","Type":"ContainerStarted","Data":"f825540d7f10f8a6e42f933baedfe23c510ed251291c7d088c5b4d1b2181dab2"}
Jul 09 18:06:36.687376 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:36.687346    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75" event={"ID":"14ea66fb-ecd1-4b41-959a-46a6d852b5d5","Type":"ContainerStarted","Data":"9ffbcd534cf0556ccaa0801f81a2c1586f43a711ea304c583a6fef752081b766"}
Jul 09 18:06:36.710364 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:36.710311    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75" podStartSLOduration=1.442844482 podStartE2EDuration="3.710295259s" totalImagesPullingTime="2.267450777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:36.70908955 +0000 UTC m=+118.208146297" watchObservedRunningTime="2026-07-09 18:06:36.710295259 +0000 UTC m=+118.209351997"
Jul 09 18:06:37.694775 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:37.694738    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3adbbb95-20b9-4b9e-8985-aabd8d9e78f2","Type":"ContainerStarted","Data":"cd34df2a4ea04031f574fa4398d93d335c2eab2eb0cc0a1e158685a10a3e3126"}
Jul 09 18:06:37.697698 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:37.697663    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc" event={"ID":"7bd9446a-9e90-4bab-b656-a39d994d30a3","Type":"ContainerStarted","Data":"670d0339736c0399040aff7a358fbb3dc56261e95334cbaef433029590bd2f1d"}
Jul 09 18:06:37.697830 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:37.697737    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc" event={"ID":"7bd9446a-9e90-4bab-b656-a39d994d30a3","Type":"ContainerStarted","Data":"a5a809396897212a3541362d8a858ae7a08ddc17c0cc99f911d680431a322429"}
Jul 09 18:06:37.697830 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:37.697776    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc" event={"ID":"7bd9446a-9e90-4bab-b656-a39d994d30a3","Type":"ContainerStarted","Data":"ef9f7939bb6cc97b62b4c1a825ada1577a625d38e1ca74fdd2d21edda1c1c1de"}
Jul 09 18:06:37.726256 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:37.726209    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.976322968 podStartE2EDuration="8.72619139s" totalImagesPullingTime="3.732643063s" totalInitContainerRuntime="17.225359ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:37.724292193 +0000 UTC m=+119.223348941" watchObservedRunningTime="2026-07-09 18:06:37.72619139 +0000 UTC m=+119.225248139"
Jul 09 18:06:37.750132 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:37.750077    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc" podStartSLOduration=2.621452289 podStartE2EDuration="7.750030016s" totalImagesPullingTime="5.128577727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:37.749216444 +0000 UTC m=+119.248273196" watchObservedRunningTime="2026-07-09 18:06:37.750030016 +0000 UTC m=+119.249086774"
Jul 09 18:06:38.702494 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:38.702458    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:39.235227 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.235190    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87bd55f4f-92869"]
Jul 09 18:06:39.269377 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.269347    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-666c47bbd4-mcgcx"]
Jul 09 18:06:39.274741 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.274715    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.285947 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.285901    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-666c47bbd4-mcgcx"]
Jul 09 18:06:39.360153 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.360114    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-console-config\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.360338 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.360162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-oauth-serving-cert\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.360338 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.360194    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-trusted-ca-bundle\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.360338 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.360224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-service-ca\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.360338 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.360253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-oauth-config\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.360338 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.360301    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-serving-cert\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.360338 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.360321    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsbx2\" (UniqueName: \"kubernetes.io/projected/4b380de0-458b-4885-a9fb-e27a785801d7-kube-api-access-wsbx2\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.461014 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.460978    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-serving-cert\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.461014 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.461022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsbx2\" (UniqueName: \"kubernetes.io/projected/4b380de0-458b-4885-a9fb-e27a785801d7-kube-api-access-wsbx2\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.461291 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.461097    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-console-config\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.461291 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.461130    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-oauth-serving-cert\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.461291 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.461164    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-trusted-ca-bundle\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.461291 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.461198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-service-ca\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.461291 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.461232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-oauth-config\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.462292 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.462259    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-oauth-serving-cert\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.462480 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.462459    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-console-config\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.462927 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.462903    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-service-ca\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.463086 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.463048    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-trusted-ca-bundle\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.464480 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.464458    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-oauth-config\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.464554 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.464513    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-serving-cert\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.471260 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.471240    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsbx2\" (UniqueName: \"kubernetes.io/projected/4b380de0-458b-4885-a9fb-e27a785801d7-kube-api-access-wsbx2\") pod \"console-666c47bbd4-mcgcx\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") " pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.586658 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.586628    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:39.738536 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:39.738497    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-666c47bbd4-mcgcx"]
Jul 09 18:06:39.743625 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:06:39.743596    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b380de0_458b_4885_a9fb_e27a785801d7.slice/crio-68de49c5ac652204f5f50eb0c4a0ae6da24969f855f8b1774ca2ac012a9a74ee WatchSource:0}: Error finding container 68de49c5ac652204f5f50eb0c4a0ae6da24969f855f8b1774ca2ac012a9a74ee: Status 404 returned error can't find the container with id 68de49c5ac652204f5f50eb0c4a0ae6da24969f855f8b1774ca2ac012a9a74ee
Jul 09 18:06:40.711519 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:40.711484    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-666c47bbd4-mcgcx" event={"ID":"4b380de0-458b-4885-a9fb-e27a785801d7","Type":"ContainerStarted","Data":"ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6"}
Jul 09 18:06:40.711715 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:40.711530    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-666c47bbd4-mcgcx" event={"ID":"4b380de0-458b-4885-a9fb-e27a785801d7","Type":"ContainerStarted","Data":"68de49c5ac652204f5f50eb0c4a0ae6da24969f855f8b1774ca2ac012a9a74ee"}
Jul 09 18:06:40.733665 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:40.733605    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-666c47bbd4-mcgcx" podStartSLOduration=1.733585958 podStartE2EDuration="1.733585958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:40.732013731 +0000 UTC m=+122.231070518" watchObservedRunningTime="2026-07-09 18:06:40.733585958 +0000 UTC m=+122.232642705"
Jul 09 18:06:43.859756 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:43.859717    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:06:44.712631 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:44.712604    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d7d9f746d-7rmgc"
Jul 09 18:06:49.458389 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.458326    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7857875887-nxzm8" podUID="25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" containerName="console" containerID="cri-o://7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968" gracePeriod=15
Jul 09 18:06:49.587641 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.587608    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:49.587786 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.587697    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:49.592473 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.592453    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:49.701501 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.701475    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:06:49.750510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.748325    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-serving-cert\") pod \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") "
Jul 09 18:06:49.750510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.748369    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-config\") pod \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") "
Jul 09 18:06:49.750510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.748424    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-oauth-serving-cert\") pod \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") "
Jul 09 18:06:49.750510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.748485    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-oauth-config\") pod \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") "
Jul 09 18:06:49.750510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.748516    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-service-ca\") pod \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") "
Jul 09 18:06:49.750510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.748572    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8pzb\" (UniqueName: \"kubernetes.io/projected/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-kube-api-access-b8pzb\") pod \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\" (UID: \"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb\") "
Jul 09 18:06:49.750510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.749875    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" (UID: "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:06:49.750510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.750384    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-config" (OuterVolumeSpecName: "console-config") pod "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" (UID: "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:06:49.751178 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.751148    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-service-ca" (OuterVolumeSpecName: "service-ca") pod "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" (UID: "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:06:49.752348 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.752314    2569 generic.go:356] "Generic (PLEG): container finished" podID="25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" containerID="7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968" exitCode=0
Jul 09 18:06:49.752464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.752343    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" (UID: "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:06:49.752464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.752369    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" (UID: "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:06:49.752464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.752381    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857875887-nxzm8"
Jul 09 18:06:49.752464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.752439    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857875887-nxzm8" event={"ID":"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb","Type":"ContainerDied","Data":"7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968"}
Jul 09 18:06:49.752665 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.752464    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-kube-api-access-b8pzb" (OuterVolumeSpecName: "kube-api-access-b8pzb") pod "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" (UID: "25a7a144-670f-4b69-aff6-7cdc0ef9a4bb"). InnerVolumeSpecName "kube-api-access-b8pzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:06:49.752665 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.752529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857875887-nxzm8" event={"ID":"25a7a144-670f-4b69-aff6-7cdc0ef9a4bb","Type":"ContainerDied","Data":"4f94d6cd0f8b3c0ca10f984be74d957a199e854299499f17340160671317d7ea"}
Jul 09 18:06:49.752665 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.752562    2569 scope.go:117] "RemoveContainer" containerID="7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968"
Jul 09 18:06:49.758146 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.758016    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:06:49.768353 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.768331    2569 scope.go:117] "RemoveContainer" containerID="7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968"
Jul 09 18:06:49.768637 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:06:49.768619    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968\": container with ID starting with 7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968 not found: ID does not exist" containerID="7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968"
Jul 09 18:06:49.768683 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.768646    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968"} err="failed to get container status \"7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968\": rpc error: code = NotFound desc = could not find container \"7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968\": container with ID starting with 7780f94a422be43dc8261e37007fcd82114f85c66557f7a4fecdf1d19b951968 not found: ID does not exist"
Jul 09 18:06:49.792273 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.792244    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7857875887-nxzm8"]
Jul 09 18:06:49.795922 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.795893    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7857875887-nxzm8"]
Jul 09 18:06:49.850262 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.850224    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-serving-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:49.850500 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.850471    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-config\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:49.850500 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.850500    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-oauth-serving-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:49.850648 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.850510    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-console-oauth-config\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:49.850648 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.850519    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-service-ca\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:49.850648 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:49.850528    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8pzb\" (UniqueName: \"kubernetes.io/projected/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb-kube-api-access-b8pzb\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:06:51.120894 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:51.120862    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" path="/var/lib/kubelet/pods/25a7a144-670f-4b69-aff6-7cdc0ef9a4bb/volumes"
Jul 09 18:06:53.381837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:53.381799    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:06:53.382243 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:06:53.381880    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:07:04.256861 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.256819    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-87bd55f4f-92869" podUID="853ec205-00d9-4d53-8621-984fff48b308" containerName="console" containerID="cri-o://c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a" gracePeriod=15
Jul 09 18:07:04.500606 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.500576    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:07:04.570869 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.570841    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-service-ca\") pod \"853ec205-00d9-4d53-8621-984fff48b308\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") "
Jul 09 18:07:04.571040 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.570884    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-oauth-config\") pod \"853ec205-00d9-4d53-8621-984fff48b308\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") "
Jul 09 18:07:04.571040 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.570956    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-serving-cert\") pod \"853ec205-00d9-4d53-8621-984fff48b308\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") "
Jul 09 18:07:04.571040 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.570998    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqg5l\" (UniqueName: \"kubernetes.io/projected/853ec205-00d9-4d53-8621-984fff48b308-kube-api-access-nqg5l\") pod \"853ec205-00d9-4d53-8621-984fff48b308\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") "
Jul 09 18:07:04.571040 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.571030    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-oauth-serving-cert\") pod \"853ec205-00d9-4d53-8621-984fff48b308\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") "
Jul 09 18:07:04.571272 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.571086    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-console-config\") pod \"853ec205-00d9-4d53-8621-984fff48b308\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") "
Jul 09 18:07:04.571272 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.571131    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-trusted-ca-bundle\") pod \"853ec205-00d9-4d53-8621-984fff48b308\" (UID: \"853ec205-00d9-4d53-8621-984fff48b308\") "
Jul 09 18:07:04.571272 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.571205    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-service-ca" (OuterVolumeSpecName: "service-ca") pod "853ec205-00d9-4d53-8621-984fff48b308" (UID: "853ec205-00d9-4d53-8621-984fff48b308"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:07:04.571499 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.571474    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-service-ca\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:07:04.571499 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.571485    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "853ec205-00d9-4d53-8621-984fff48b308" (UID: "853ec205-00d9-4d53-8621-984fff48b308"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:07:04.571499 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.571493    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-console-config" (OuterVolumeSpecName: "console-config") pod "853ec205-00d9-4d53-8621-984fff48b308" (UID: "853ec205-00d9-4d53-8621-984fff48b308"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:07:04.571669 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.571604    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "853ec205-00d9-4d53-8621-984fff48b308" (UID: "853ec205-00d9-4d53-8621-984fff48b308"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:07:04.573125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.573103    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853ec205-00d9-4d53-8621-984fff48b308-kube-api-access-nqg5l" (OuterVolumeSpecName: "kube-api-access-nqg5l") pod "853ec205-00d9-4d53-8621-984fff48b308" (UID: "853ec205-00d9-4d53-8621-984fff48b308"). InnerVolumeSpecName "kube-api-access-nqg5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:07:04.573534 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.573517    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "853ec205-00d9-4d53-8621-984fff48b308" (UID: "853ec205-00d9-4d53-8621-984fff48b308"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:07:04.573609 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.573534    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "853ec205-00d9-4d53-8621-984fff48b308" (UID: "853ec205-00d9-4d53-8621-984fff48b308"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:07:04.672688 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.672660    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-oauth-config\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:07:04.672688 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.672683    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853ec205-00d9-4d53-8621-984fff48b308-console-serving-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:07:04.672688 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.672692    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqg5l\" (UniqueName: \"kubernetes.io/projected/853ec205-00d9-4d53-8621-984fff48b308-kube-api-access-nqg5l\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:07:04.672868 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.672701    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-oauth-serving-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:07:04.672868 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.672710    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-console-config\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:07:04.672868 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.672718    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853ec205-00d9-4d53-8621-984fff48b308-trusted-ca-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:07:04.810212 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.810175    2569 generic.go:356] "Generic (PLEG): container finished" podID="853ec205-00d9-4d53-8621-984fff48b308" containerID="c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a" exitCode=0
Jul 09 18:07:04.810212 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.810214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87bd55f4f-92869" event={"ID":"853ec205-00d9-4d53-8621-984fff48b308","Type":"ContainerDied","Data":"c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a"}
Jul 09 18:07:04.810510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.810226    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87bd55f4f-92869"
Jul 09 18:07:04.810510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.810255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87bd55f4f-92869" event={"ID":"853ec205-00d9-4d53-8621-984fff48b308","Type":"ContainerDied","Data":"1228c306181f7a962f67855e72f2dc86c5e36e72a3b3d33f8424f3506b187361"}
Jul 09 18:07:04.810510 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.810277    2569 scope.go:117] "RemoveContainer" containerID="c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a"
Jul 09 18:07:04.818794 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.818777    2569 scope.go:117] "RemoveContainer" containerID="c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a"
Jul 09 18:07:04.819027 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:07:04.819010    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a\": container with ID starting with c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a not found: ID does not exist" containerID="c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a"
Jul 09 18:07:04.819086 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.819035    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a"} err="failed to get container status \"c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a\": rpc error: code = NotFound desc = could not find container \"c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a\": container with ID starting with c4eaedc55d38c6c76a73b1e6fb2770f3bb0c75987afb71977ad06b8521ac3d0a not found: ID does not exist"
Jul 09 18:07:04.835130 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.835047    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87bd55f4f-92869"]
Jul 09 18:07:04.836535 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:04.836516    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-87bd55f4f-92869"]
Jul 09 18:07:05.121028 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:05.120945    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853ec205-00d9-4d53-8621-984fff48b308" path="/var/lib/kubelet/pods/853ec205-00d9-4d53-8621-984fff48b308/volumes"
Jul 09 18:07:13.387238 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:13.387208    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:07:13.390875 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:13.390855    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55df8d4f4b-xmg75"
Jul 09 18:07:45.354196 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.354159    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc57494b7-vg6qt"]
Jul 09 18:07:45.354636 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.354473    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853ec205-00d9-4d53-8621-984fff48b308" containerName="console"
Jul 09 18:07:45.354636 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.354485    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="853ec205-00d9-4d53-8621-984fff48b308" containerName="console"
Jul 09 18:07:45.354636 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.354505    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" containerName="console"
Jul 09 18:07:45.354636 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.354510    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" containerName="console"
Jul 09 18:07:45.354636 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.354554    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="853ec205-00d9-4d53-8621-984fff48b308" containerName="console"
Jul 09 18:07:45.354636 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.354565    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="25a7a144-670f-4b69-aff6-7cdc0ef9a4bb" containerName="console"
Jul 09 18:07:45.357418 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.357397    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.369548 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.369517    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc57494b7-vg6qt"]
Jul 09 18:07:45.373357 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.373330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-config\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.373512 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.373364    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drqk5\" (UniqueName: \"kubernetes.io/projected/51c08cd4-1976-4a62-9398-2ff0f0c6658b-kube-api-access-drqk5\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.373512 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.373387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-oauth-serving-cert\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.373512 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.373445    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-service-ca\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.373512 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.373475    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-oauth-config\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.373512 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.373498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-serving-cert\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.373718 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.373523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-trusted-ca-bundle\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.474049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474008    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-config\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.474049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474078    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drqk5\" (UniqueName: \"kubernetes.io/projected/51c08cd4-1976-4a62-9398-2ff0f0c6658b-kube-api-access-drqk5\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.474304 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474108    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-oauth-serving-cert\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.474304 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-service-ca\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.474304 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-oauth-config\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.474304 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-serving-cert\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.474501 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474345    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-trusted-ca-bundle\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.474939 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474909    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-config\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.475185 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.474997    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-oauth-serving-cert\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.475286 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.475039    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-service-ca\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.475286 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.475197    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-trusted-ca-bundle\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.476672 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.476649    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-oauth-config\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.476792 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.476774    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-serving-cert\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.483710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.483679    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drqk5\" (UniqueName: \"kubernetes.io/projected/51c08cd4-1976-4a62-9398-2ff0f0c6658b-kube-api-access-drqk5\") pod \"console-7dc57494b7-vg6qt\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") " pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.667775 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.667673    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:45.804925 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.804727    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc57494b7-vg6qt"]
Jul 09 18:07:45.807826 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:07:45.807782    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c08cd4_1976_4a62_9398_2ff0f0c6658b.slice/crio-d21f088c0b5c0c44b09a912ac883b32a5bcfb711b9ea0581870f04b05dfed720 WatchSource:0}: Error finding container d21f088c0b5c0c44b09a912ac883b32a5bcfb711b9ea0581870f04b05dfed720: Status 404 returned error can't find the container with id d21f088c0b5c0c44b09a912ac883b32a5bcfb711b9ea0581870f04b05dfed720
Jul 09 18:07:45.966131 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.966026    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc57494b7-vg6qt" event={"ID":"51c08cd4-1976-4a62-9398-2ff0f0c6658b","Type":"ContainerStarted","Data":"6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a"}
Jul 09 18:07:45.966131 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.966120    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc57494b7-vg6qt" event={"ID":"51c08cd4-1976-4a62-9398-2ff0f0c6658b","Type":"ContainerStarted","Data":"d21f088c0b5c0c44b09a912ac883b32a5bcfb711b9ea0581870f04b05dfed720"}
Jul 09 18:07:45.984519 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:45.984469    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc57494b7-vg6qt" podStartSLOduration=0.984452178 podStartE2EDuration="984.452178ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:07:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:07:45.984222019 +0000 UTC m=+187.483278781" watchObservedRunningTime="2026-07-09 18:07:45.984452178 +0000 UTC m=+187.483508926"
Jul 09 18:07:55.667954 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:55.667916    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:55.668408 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:55.668007    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:55.672840 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:55.672817    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:56.007750 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:56.007666    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:07:56.085207 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:07:56.085171    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-666c47bbd4-mcgcx"]
Jul 09 18:08:21.105086 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.105033    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-666c47bbd4-mcgcx" podUID="4b380de0-458b-4885-a9fb-e27a785801d7" containerName="console" containerID="cri-o://ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6" gracePeriod=15
Jul 09 18:08:21.349717 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.349694    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:08:21.474458 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474363    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-trusted-ca-bundle\") pod \"4b380de0-458b-4885-a9fb-e27a785801d7\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") "
Jul 09 18:08:21.474458 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474408    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-oauth-serving-cert\") pod \"4b380de0-458b-4885-a9fb-e27a785801d7\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") "
Jul 09 18:08:21.474458 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474444    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-serving-cert\") pod \"4b380de0-458b-4885-a9fb-e27a785801d7\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") "
Jul 09 18:08:21.474735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474489    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-console-config\") pod \"4b380de0-458b-4885-a9fb-e27a785801d7\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") "
Jul 09 18:08:21.474735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474535    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsbx2\" (UniqueName: \"kubernetes.io/projected/4b380de0-458b-4885-a9fb-e27a785801d7-kube-api-access-wsbx2\") pod \"4b380de0-458b-4885-a9fb-e27a785801d7\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") "
Jul 09 18:08:21.474735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474562    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-oauth-config\") pod \"4b380de0-458b-4885-a9fb-e27a785801d7\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") "
Jul 09 18:08:21.474735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474595    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-service-ca\") pod \"4b380de0-458b-4885-a9fb-e27a785801d7\" (UID: \"4b380de0-458b-4885-a9fb-e27a785801d7\") "
Jul 09 18:08:21.474930 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474790    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4b380de0-458b-4885-a9fb-e27a785801d7" (UID: "4b380de0-458b-4885-a9fb-e27a785801d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:08:21.474986 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.474936    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-console-config" (OuterVolumeSpecName: "console-config") pod "4b380de0-458b-4885-a9fb-e27a785801d7" (UID: "4b380de0-458b-4885-a9fb-e27a785801d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:08:21.475216 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.475184    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "4b380de0-458b-4885-a9fb-e27a785801d7" (UID: "4b380de0-458b-4885-a9fb-e27a785801d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:08:21.475216 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.475211    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4b380de0-458b-4885-a9fb-e27a785801d7" (UID: "4b380de0-458b-4885-a9fb-e27a785801d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:08:21.476729 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.476688    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4b380de0-458b-4885-a9fb-e27a785801d7" (UID: "4b380de0-458b-4885-a9fb-e27a785801d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:08:21.476825 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.476760    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4b380de0-458b-4885-a9fb-e27a785801d7" (UID: "4b380de0-458b-4885-a9fb-e27a785801d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:08:21.476825 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.476771    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b380de0-458b-4885-a9fb-e27a785801d7-kube-api-access-wsbx2" (OuterVolumeSpecName: "kube-api-access-wsbx2") pod "4b380de0-458b-4885-a9fb-e27a785801d7" (UID: "4b380de0-458b-4885-a9fb-e27a785801d7"). InnerVolumeSpecName "kube-api-access-wsbx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:08:21.575721 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.575683    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-trusted-ca-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:21.575721 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.575715    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-oauth-serving-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:21.575721 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.575725    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-serving-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:21.575721 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.575734    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-console-config\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:21.575984 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.575743    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsbx2\" (UniqueName: \"kubernetes.io/projected/4b380de0-458b-4885-a9fb-e27a785801d7-kube-api-access-wsbx2\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:21.575984 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.575751    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b380de0-458b-4885-a9fb-e27a785801d7-console-oauth-config\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:21.575984 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:21.575762    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b380de0-458b-4885-a9fb-e27a785801d7-service-ca\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:22.103554 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.103518    2569 generic.go:356] "Generic (PLEG): container finished" podID="4b380de0-458b-4885-a9fb-e27a785801d7" containerID="ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6" exitCode=0
Jul 09 18:08:22.103728 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.103570    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-666c47bbd4-mcgcx"
Jul 09 18:08:22.103728 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.103575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-666c47bbd4-mcgcx" event={"ID":"4b380de0-458b-4885-a9fb-e27a785801d7","Type":"ContainerDied","Data":"ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6"}
Jul 09 18:08:22.103728 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.103629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-666c47bbd4-mcgcx" event={"ID":"4b380de0-458b-4885-a9fb-e27a785801d7","Type":"ContainerDied","Data":"68de49c5ac652204f5f50eb0c4a0ae6da24969f855f8b1774ca2ac012a9a74ee"}
Jul 09 18:08:22.103728 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.103658    2569 scope.go:117] "RemoveContainer" containerID="ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6"
Jul 09 18:08:22.112216 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.112100    2569 scope.go:117] "RemoveContainer" containerID="ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6"
Jul 09 18:08:22.112441 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:08:22.112395    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6\": container with ID starting with ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6 not found: ID does not exist" containerID="ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6"
Jul 09 18:08:22.112441 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.112419    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6"} err="failed to get container status \"ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6\": rpc error: code = NotFound desc = could not find container \"ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6\": container with ID starting with ccf5ef1b0283bb9d6dadb73d448d807bb16d64cd2596549639fb0f2a87dca5d6 not found: ID does not exist"
Jul 09 18:08:22.124530 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.124509    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-666c47bbd4-mcgcx"]
Jul 09 18:08:22.129110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:22.129083    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-666c47bbd4-mcgcx"]
Jul 09 18:08:23.120131 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:23.120098    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b380de0-458b-4885-a9fb-e27a785801d7" path="/var/lib/kubelet/pods/4b380de0-458b-4885-a9fb-e27a785801d7/volumes"
Jul 09 18:08:37.656563 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.656523    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"]
Jul 09 18:08:37.656929 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.656819    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b380de0-458b-4885-a9fb-e27a785801d7" containerName="console"
Jul 09 18:08:37.656929 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.656831    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b380de0-458b-4885-a9fb-e27a785801d7" containerName="console"
Jul 09 18:08:37.656929 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.656879    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b380de0-458b-4885-a9fb-e27a785801d7" containerName="console"
Jul 09 18:08:37.659782 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.659766    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.662598 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.662576    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:08:37.662715 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.662623    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:08:37.663778 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.663753    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gkw28\""
Jul 09 18:08:37.669613 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.669590    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"]
Jul 09 18:08:37.801334 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.801294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxwh2\" (UniqueName: \"kubernetes.io/projected/7333e15e-9927-4f29-a1c4-0902cba7e8b7-kube-api-access-gxwh2\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.801334 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.801335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.801547 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.801356    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.901808 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.901770    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.901808 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.901805    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.902006 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.901883    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxwh2\" (UniqueName: \"kubernetes.io/projected/7333e15e-9927-4f29-a1c4-0902cba7e8b7-kube-api-access-gxwh2\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.902275 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.902251    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.902320 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.902261    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.911748 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.911684    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxwh2\" (UniqueName: \"kubernetes.io/projected/7333e15e-9927-4f29-a1c4-0902cba7e8b7-kube-api-access-gxwh2\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:37.969190 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:37.969155    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:38.098148 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:38.098088    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"]
Jul 09 18:08:38.100649 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:08:38.100621    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7333e15e_9927_4f29_a1c4_0902cba7e8b7.slice/crio-7f04f02241711ad5e24e53f840a63e63df68902e7d778281f9622dfa3369abc2 WatchSource:0}: Error finding container 7f04f02241711ad5e24e53f840a63e63df68902e7d778281f9622dfa3369abc2: Status 404 returned error can't find the container with id 7f04f02241711ad5e24e53f840a63e63df68902e7d778281f9622dfa3369abc2
Jul 09 18:08:38.165750 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:38.165665    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg" event={"ID":"7333e15e-9927-4f29-a1c4-0902cba7e8b7","Type":"ContainerStarted","Data":"7f04f02241711ad5e24e53f840a63e63df68902e7d778281f9622dfa3369abc2"}
Jul 09 18:08:46.201337 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:46.201301    2569 generic.go:356] "Generic (PLEG): container finished" podID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerID="87dfb2dafdf9966096bb5f3db7f74dc28050b6ebbb329c281259c7a19f4b71e1" exitCode=0
Jul 09 18:08:46.201768 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:46.201395    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg" event={"ID":"7333e15e-9927-4f29-a1c4-0902cba7e8b7","Type":"ContainerDied","Data":"87dfb2dafdf9966096bb5f3db7f74dc28050b6ebbb329c281259c7a19f4b71e1"}
Jul 09 18:08:48.210182 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:48.210148    2569 generic.go:356] "Generic (PLEG): container finished" podID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerID="e6b48cfa418290bf27fca0086271a338693ff96e45f579edeca130aa24d94338" exitCode=0
Jul 09 18:08:48.210499 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:48.210235    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg" event={"ID":"7333e15e-9927-4f29-a1c4-0902cba7e8b7","Type":"ContainerDied","Data":"e6b48cfa418290bf27fca0086271a338693ff96e45f579edeca130aa24d94338"}
Jul 09 18:08:54.237039 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:54.236972    2569 generic.go:356] "Generic (PLEG): container finished" podID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerID="1e9c941ef7770488fca68ef4ff8755ac9d2931c7de36e50713f15cdedb853278" exitCode=0
Jul 09 18:08:54.237422 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:54.237047    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg" event={"ID":"7333e15e-9927-4f29-a1c4-0902cba7e8b7","Type":"ContainerDied","Data":"1e9c941ef7770488fca68ef4ff8755ac9d2931c7de36e50713f15cdedb853278"}
Jul 09 18:08:55.362938 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.362917    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:55.447456 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.447427    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-util\") pod \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") "
Jul 09 18:08:55.447590 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.447481    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-bundle\") pod \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") "
Jul 09 18:08:55.447590 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.447572    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxwh2\" (UniqueName: \"kubernetes.io/projected/7333e15e-9927-4f29-a1c4-0902cba7e8b7-kube-api-access-gxwh2\") pod \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\" (UID: \"7333e15e-9927-4f29-a1c4-0902cba7e8b7\") "
Jul 09 18:08:55.448043 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.448014    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-bundle" (OuterVolumeSpecName: "bundle") pod "7333e15e-9927-4f29-a1c4-0902cba7e8b7" (UID: "7333e15e-9927-4f29-a1c4-0902cba7e8b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:08:55.449646 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.449622    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7333e15e-9927-4f29-a1c4-0902cba7e8b7-kube-api-access-gxwh2" (OuterVolumeSpecName: "kube-api-access-gxwh2") pod "7333e15e-9927-4f29-a1c4-0902cba7e8b7" (UID: "7333e15e-9927-4f29-a1c4-0902cba7e8b7"). InnerVolumeSpecName "kube-api-access-gxwh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:08:55.452278 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.452260    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-util" (OuterVolumeSpecName: "util") pod "7333e15e-9927-4f29-a1c4-0902cba7e8b7" (UID: "7333e15e-9927-4f29-a1c4-0902cba7e8b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:08:55.548912 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.548855    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-util\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:55.548912 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.548875    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7333e15e-9927-4f29-a1c4-0902cba7e8b7-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:55.548912 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:55.548884    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxwh2\" (UniqueName: \"kubernetes.io/projected/7333e15e-9927-4f29-a1c4-0902cba7e8b7-kube-api-access-gxwh2\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:08:56.248419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:56.248380    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg" event={"ID":"7333e15e-9927-4f29-a1c4-0902cba7e8b7","Type":"ContainerDied","Data":"7f04f02241711ad5e24e53f840a63e63df68902e7d778281f9622dfa3369abc2"}
Jul 09 18:08:56.248419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:56.248403    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589grrpg"
Jul 09 18:08:56.248419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:08:56.248425    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f04f02241711ad5e24e53f840a63e63df68902e7d778281f9622dfa3369abc2"
Jul 09 18:09:01.590589 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.590511    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"]
Jul 09 18:09:01.590941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.590846    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerName="util"
Jul 09 18:09:01.590941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.590859    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerName="util"
Jul 09 18:09:01.590941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.590873    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerName="extract"
Jul 09 18:09:01.590941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.590879    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerName="extract"
Jul 09 18:09:01.590941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.590890    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerName="pull"
Jul 09 18:09:01.590941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.590895    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerName="pull"
Jul 09 18:09:01.590941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.590944    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7333e15e-9927-4f29-a1c4-0902cba7e8b7" containerName="extract"
Jul 09 18:09:01.592794 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.592778    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:01.597910 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.597886    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 09 18:09:01.598045 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.597982    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-vmqjn\""
Jul 09 18:09:01.598402 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.598384    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 09 18:09:01.598500 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.598423    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 09 18:09:01.629015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.628994    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"]
Jul 09 18:09:01.694679 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.694652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/df31023f-7e6c-47c7-a3fd-766149ff0df5-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc\" (UID: \"df31023f-7e6c-47c7-a3fd-766149ff0df5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:01.694801 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.694686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbqkh\" (UniqueName: \"kubernetes.io/projected/df31023f-7e6c-47c7-a3fd-766149ff0df5-kube-api-access-tbqkh\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc\" (UID: \"df31023f-7e6c-47c7-a3fd-766149ff0df5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:01.795375 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.795336    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/df31023f-7e6c-47c7-a3fd-766149ff0df5-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc\" (UID: \"df31023f-7e6c-47c7-a3fd-766149ff0df5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:01.795375 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.795377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbqkh\" (UniqueName: \"kubernetes.io/projected/df31023f-7e6c-47c7-a3fd-766149ff0df5-kube-api-access-tbqkh\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc\" (UID: \"df31023f-7e6c-47c7-a3fd-766149ff0df5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:01.797566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.797539    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/df31023f-7e6c-47c7-a3fd-766149ff0df5-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc\" (UID: \"df31023f-7e6c-47c7-a3fd-766149ff0df5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:01.814115 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.814093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbqkh\" (UniqueName: \"kubernetes.io/projected/df31023f-7e6c-47c7-a3fd-766149ff0df5-kube-api-access-tbqkh\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc\" (UID: \"df31023f-7e6c-47c7-a3fd-766149ff0df5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:01.902194 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:01.902140    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:02.045136 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:02.045109    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"]
Jul 09 18:09:02.096511 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:09:02.096488    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf31023f_7e6c_47c7_a3fd_766149ff0df5.slice/crio-b081736b9cbf39bd6348136a65471d2545812db708041f9103e2a04ca522c75f WatchSource:0}: Error finding container b081736b9cbf39bd6348136a65471d2545812db708041f9103e2a04ca522c75f: Status 404 returned error can't find the container with id b081736b9cbf39bd6348136a65471d2545812db708041f9103e2a04ca522c75f
Jul 09 18:09:02.272123 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:02.272035    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc" event={"ID":"df31023f-7e6c-47c7-a3fd-766149ff0df5","Type":"ContainerStarted","Data":"b081736b9cbf39bd6348136a65471d2545812db708041f9103e2a04ca522c75f"}
Jul 09 18:09:05.286672 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.286630    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc" event={"ID":"df31023f-7e6c-47c7-a3fd-766149ff0df5","Type":"ContainerStarted","Data":"88a653431c50f353f0dc797dd8613d7c8b6ecb741f7cf90fd91e7800a73c9c57"}
Jul 09 18:09:05.287028 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.286722    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:05.314752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.314691    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc" podStartSLOduration=1.67997295 podStartE2EDuration="4.314675073s" totalImagesPullingTime="2.634702123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:09:05.312764104 +0000 UTC m=+266.811820852" watchObservedRunningTime="2026-07-09 18:09:05.314675073 +0000 UTC m=+266.813731819"
Jul 09 18:09:05.450175 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.450146    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-hldhs"]
Jul 09 18:09:05.454010 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.453980    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.457517 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.457494    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 09 18:09:05.457673 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.457519    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-n9snr\""
Jul 09 18:09:05.457673 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.457520    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 09 18:09:05.464120 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.463870    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-hldhs"]
Jul 09 18:09:05.526620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.526586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtp5c\" (UniqueName: \"kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-kube-api-access-vtp5c\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.526795 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.526653    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-certificates\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.526795 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.526710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5dc3ab38-ceae-4039-bde1-a404faec3b83-cabundle0\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.627642 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.627607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtp5c\" (UniqueName: \"kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-kube-api-access-vtp5c\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.627811 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.627659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-certificates\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.627811 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:09:05.627747    2569 secret.go:281] references non-existent secret key: ca.crt
Jul 09 18:09:05.627811 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:09:05.627763    2569 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 09 18:09:05.627811 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:09:05.627775    2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-hldhs: references non-existent secret key: ca.crt
Jul 09 18:09:05.627811 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.627790    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5dc3ab38-ceae-4039-bde1-a404faec3b83-cabundle0\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.628008 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:09:05.627834    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-certificates podName:5dc3ab38-ceae-4039-bde1-a404faec3b83 nodeName:}" failed. No retries permitted until 2026-07-09 18:09:06.127815406 +0000 UTC m=+267.626872135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-certificates") pod "keda-operator-68bff59c-hldhs" (UID: "5dc3ab38-ceae-4039-bde1-a404faec3b83") : references non-existent secret key: ca.crt
Jul 09 18:09:05.628519 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.628498    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5dc3ab38-ceae-4039-bde1-a404faec3b83-cabundle0\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.637279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.637247    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtp5c\" (UniqueName: \"kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-kube-api-access-vtp5c\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:05.897180 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.897107    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"]
Jul 09 18:09:05.899650 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.899635    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:05.902827 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.902806    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 09 18:09:05.917788 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:05.917764    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"]
Jul 09 18:09:06.032544 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.032511    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-certificates\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.032682 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.032579    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6dl\" (UniqueName: \"kubernetes.io/projected/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-kube-api-access-6h6dl\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.032682 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.032626    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.133698 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.133671    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-certificates\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:06.133893 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.133723    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-certificates\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.133893 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.133781    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6dl\" (UniqueName: \"kubernetes.io/projected/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-kube-api-access-6h6dl\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.133893 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.133827    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.134251 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.134226    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.136702 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.136679    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5dc3ab38-ceae-4039-bde1-a404faec3b83-certificates\") pod \"keda-operator-68bff59c-hldhs\" (UID: \"5dc3ab38-ceae-4039-bde1-a404faec3b83\") " pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:06.137144 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.137125    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-certificates\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.145086 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.144433    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6dl\" (UniqueName: \"kubernetes.io/projected/1b6738fb-cef6-482e-bcb5-b0ba3f3949b3-kube-api-access-6h6dl\") pod \"keda-metrics-apiserver-559f75f947-gh6xd\" (UID: \"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.186958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.186878    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-8dl78"]
Jul 09 18:09:06.189182 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.189166    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:06.191976 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.191955    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 09 18:09:06.200726 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.200701    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-8dl78"]
Jul 09 18:09:06.210753 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.210735    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:06.234756 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.234732    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-certificates\") pod \"keda-admission-5fbd5c4644-8dl78\" (UID: \"36b325a5-7f36-4954-ab91-9e03594814ce\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:06.234870 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.234793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh8k2\" (UniqueName: \"kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-kube-api-access-nh8k2\") pod \"keda-admission-5fbd5c4644-8dl78\" (UID: \"36b325a5-7f36-4954-ab91-9e03594814ce\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:06.336100 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.336066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-certificates\") pod \"keda-admission-5fbd5c4644-8dl78\" (UID: \"36b325a5-7f36-4954-ab91-9e03594814ce\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:06.336554 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:09:06.336178    2569 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 09 18:09:06.336554 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:09:06.336204    2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-8dl78: secret "keda-admission-webhooks-certs" not found
Jul 09 18:09:06.336554 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.336199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8k2\" (UniqueName: \"kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-kube-api-access-nh8k2\") pod \"keda-admission-5fbd5c4644-8dl78\" (UID: \"36b325a5-7f36-4954-ab91-9e03594814ce\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:06.336554 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:09:06.336266    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-certificates podName:36b325a5-7f36-4954-ab91-9e03594814ce nodeName:}" failed. No retries permitted until 2026-07-09 18:09:06.836246329 +0000 UTC m=+268.335303076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-certificates") pod "keda-admission-5fbd5c4644-8dl78" (UID: "36b325a5-7f36-4954-ab91-9e03594814ce") : secret "keda-admission-webhooks-certs" not found
Jul 09 18:09:06.350782 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.350753    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh8k2\" (UniqueName: \"kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-kube-api-access-nh8k2\") pod \"keda-admission-5fbd5c4644-8dl78\" (UID: \"36b325a5-7f36-4954-ab91-9e03594814ce\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:06.368406 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.368195    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:06.370566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.370389    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"]
Jul 09 18:09:06.373582 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:09:06.373541    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6738fb_cef6_482e_bcb5_b0ba3f3949b3.slice/crio-11e34250ff2a89da6b54e4de07b2f6770cbecd158acd4f1cc51a01ad5c8cee07 WatchSource:0}: Error finding container 11e34250ff2a89da6b54e4de07b2f6770cbecd158acd4f1cc51a01ad5c8cee07: Status 404 returned error can't find the container with id 11e34250ff2a89da6b54e4de07b2f6770cbecd158acd4f1cc51a01ad5c8cee07
Jul 09 18:09:06.513902 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.513873    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-hldhs"]
Jul 09 18:09:06.517705 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:09:06.517682    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc3ab38_ceae_4039_bde1_a404faec3b83.slice/crio-d1fc16228c1db6d68f544521578a77c5d75c459c8ac10286e630cf02e3ff72b4 WatchSource:0}: Error finding container d1fc16228c1db6d68f544521578a77c5d75c459c8ac10286e630cf02e3ff72b4: Status 404 returned error can't find the container with id d1fc16228c1db6d68f544521578a77c5d75c459c8ac10286e630cf02e3ff72b4
Jul 09 18:09:06.840105 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.840076    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-certificates\") pod \"keda-admission-5fbd5c4644-8dl78\" (UID: \"36b325a5-7f36-4954-ab91-9e03594814ce\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:06.842433 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:06.842415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/36b325a5-7f36-4954-ab91-9e03594814ce-certificates\") pod \"keda-admission-5fbd5c4644-8dl78\" (UID: \"36b325a5-7f36-4954-ab91-9e03594814ce\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:07.100527 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:07.100446    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:07.239216 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:07.238880    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-8dl78"]
Jul 09 18:09:07.242083 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:09:07.242023    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b325a5_7f36_4954_ab91_9e03594814ce.slice/crio-cee56266d4e27a3a233d0b2e6f8e05f293d9d9beefd47680ec4668653728ba05 WatchSource:0}: Error finding container cee56266d4e27a3a233d0b2e6f8e05f293d9d9beefd47680ec4668653728ba05: Status 404 returned error can't find the container with id cee56266d4e27a3a233d0b2e6f8e05f293d9d9beefd47680ec4668653728ba05
Jul 09 18:09:07.297192 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:07.297158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-hldhs" event={"ID":"5dc3ab38-ceae-4039-bde1-a404faec3b83","Type":"ContainerStarted","Data":"d1fc16228c1db6d68f544521578a77c5d75c459c8ac10286e630cf02e3ff72b4"}
Jul 09 18:09:07.298278 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:07.298256    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-8dl78" event={"ID":"36b325a5-7f36-4954-ab91-9e03594814ce","Type":"ContainerStarted","Data":"cee56266d4e27a3a233d0b2e6f8e05f293d9d9beefd47680ec4668653728ba05"}
Jul 09 18:09:07.299349 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:07.299332    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd" event={"ID":"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3","Type":"ContainerStarted","Data":"11e34250ff2a89da6b54e4de07b2f6770cbecd158acd4f1cc51a01ad5c8cee07"}
Jul 09 18:09:11.323313 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:11.323270    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-8dl78" event={"ID":"36b325a5-7f36-4954-ab91-9e03594814ce","Type":"ContainerStarted","Data":"1255a65eedb80f0301f2535a4ae5e8d47efc6e771812c73798ebcdd0eabac9ba"}
Jul 09 18:09:11.323729 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:11.323361    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:11.324767 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:11.324740    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd" event={"ID":"1b6738fb-cef6-482e-bcb5-b0ba3f3949b3","Type":"ContainerStarted","Data":"72dbc9ca7c0b5df1729e4e1c8e2e19fd79a31001eac767824c72268faaacd643"}
Jul 09 18:09:11.324862 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:11.324819    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:11.344308 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:11.344263    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-8dl78" podStartSLOduration=2.010608675 podStartE2EDuration="5.344249759s" totalImagesPullingTime="3.333641084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:09:11.342541059 +0000 UTC m=+272.841597806" watchObservedRunningTime="2026-07-09 18:09:11.344249759 +0000 UTC m=+272.843306506"
Jul 09 18:09:11.364231 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:11.364194    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd" podStartSLOduration=2.155667962 podStartE2EDuration="6.36418229s" totalImagesPullingTime="4.208514328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:09:11.36286966 +0000 UTC m=+272.861926406" watchObservedRunningTime="2026-07-09 18:09:11.36418229 +0000 UTC m=+272.863239036"
Jul 09 18:09:16.347221 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:16.347187    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-hldhs" event={"ID":"5dc3ab38-ceae-4039-bde1-a404faec3b83","Type":"ContainerStarted","Data":"4c209a0809a540aefca0eb881d6037e16722af8e91536e2adace97942be551ad"}
Jul 09 18:09:16.347591 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:16.347292    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:16.368411 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:16.368366    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-hldhs" podStartSLOduration=1.967862947 podStartE2EDuration="11.368351349s" totalImagesPullingTime="9.400488402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:09:16.367336667 +0000 UTC m=+277.866393414" watchObservedRunningTime="2026-07-09 18:09:16.368351349 +0000 UTC m=+277.867408095"
Jul 09 18:09:22.333431 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:22.333404    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-gh6xd"
Jul 09 18:09:26.293564 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:26.293534    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-4q6fc"
Jul 09 18:09:32.331862 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:32.331834    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-8dl78"
Jul 09 18:09:37.354273 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:37.354248    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-hldhs"
Jul 09 18:09:38.929103 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:38.929070    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:09:38.929103 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:38.929083    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:09:38.934934 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:09:38.934915    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 18:10:19.680761 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.680728    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-7zbdq"]
Jul 09 18:10:19.683574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.683557    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:19.686471 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.686443    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 09 18:10:19.686690 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.686672    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 09 18:10:19.687798 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.687782    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-p9hlp\""
Jul 09 18:10:19.687908 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.687815    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 09 18:10:19.692901 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.692848    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-7zbdq"]
Jul 09 18:10:19.700844 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.700824    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"]
Jul 09 18:10:19.703063 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.703038    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:19.706204 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.706187    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-5nll4\""
Jul 09 18:10:19.706873 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.706556    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 09 18:10:19.716290 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.716270    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"]
Jul 09 18:10:19.727071 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.727039    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-dwwvf"]
Jul 09 18:10:19.729414 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.729395    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:19.731948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.731931    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 09 18:10:19.732080 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.731932    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-tccgw\""
Jul 09 18:10:19.742267 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.742246    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-dwwvf"]
Jul 09 18:10:19.830672 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.830638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhh4h\" (UniqueName: \"kubernetes.io/projected/2d9d0703-6626-4f35-bbf6-76bef79ba397-kube-api-access-qhh4h\") pod \"kserve-controller-manager-57b57d8c6-7zbdq\" (UID: \"2d9d0703-6626-4f35-bbf6-76bef79ba397\") " pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:19.830810 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.830692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc7e0dd7-f664-44cc-9147-a14e91bf87bf-data\") pod \"seaweedfs-64568bcd49-dwwvf\" (UID: \"bc7e0dd7-f664-44cc-9147-a14e91bf87bf\") " pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:19.830810 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.830740    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sgnt\" (UniqueName: \"kubernetes.io/projected/bc7e0dd7-f664-44cc-9147-a14e91bf87bf-kube-api-access-7sgnt\") pod \"seaweedfs-64568bcd49-dwwvf\" (UID: \"bc7e0dd7-f664-44cc-9147-a14e91bf87bf\") " pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:19.830810 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.830763    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966b2\" (UniqueName: \"kubernetes.io/projected/3d9fb476-32eb-4156-87f3-6a2448202da0-kube-api-access-966b2\") pod \"llmisvc-controller-manager-74f75ff8c4-wxkhq\" (UID: \"3d9fb476-32eb-4156-87f3-6a2448202da0\") " pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:19.830940 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.830826    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d9d0703-6626-4f35-bbf6-76bef79ba397-cert\") pod \"kserve-controller-manager-57b57d8c6-7zbdq\" (UID: \"2d9d0703-6626-4f35-bbf6-76bef79ba397\") " pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:19.830940 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.830878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d9fb476-32eb-4156-87f3-6a2448202da0-cert\") pod \"llmisvc-controller-manager-74f75ff8c4-wxkhq\" (UID: \"3d9fb476-32eb-4156-87f3-6a2448202da0\") " pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:19.932075 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.931976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d9fb476-32eb-4156-87f3-6a2448202da0-cert\") pod \"llmisvc-controller-manager-74f75ff8c4-wxkhq\" (UID: \"3d9fb476-32eb-4156-87f3-6a2448202da0\") " pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:19.932075 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.932042    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh4h\" (UniqueName: \"kubernetes.io/projected/2d9d0703-6626-4f35-bbf6-76bef79ba397-kube-api-access-qhh4h\") pod \"kserve-controller-manager-57b57d8c6-7zbdq\" (UID: \"2d9d0703-6626-4f35-bbf6-76bef79ba397\") " pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:19.932251 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.932111    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc7e0dd7-f664-44cc-9147-a14e91bf87bf-data\") pod \"seaweedfs-64568bcd49-dwwvf\" (UID: \"bc7e0dd7-f664-44cc-9147-a14e91bf87bf\") " pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:19.932251 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.932136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgnt\" (UniqueName: \"kubernetes.io/projected/bc7e0dd7-f664-44cc-9147-a14e91bf87bf-kube-api-access-7sgnt\") pod \"seaweedfs-64568bcd49-dwwvf\" (UID: \"bc7e0dd7-f664-44cc-9147-a14e91bf87bf\") " pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:19.932251 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.932159    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966b2\" (UniqueName: \"kubernetes.io/projected/3d9fb476-32eb-4156-87f3-6a2448202da0-kube-api-access-966b2\") pod \"llmisvc-controller-manager-74f75ff8c4-wxkhq\" (UID: \"3d9fb476-32eb-4156-87f3-6a2448202da0\") " pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:19.932251 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.932195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d9d0703-6626-4f35-bbf6-76bef79ba397-cert\") pod \"kserve-controller-manager-57b57d8c6-7zbdq\" (UID: \"2d9d0703-6626-4f35-bbf6-76bef79ba397\") " pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:19.932527 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.932507    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc7e0dd7-f664-44cc-9147-a14e91bf87bf-data\") pod \"seaweedfs-64568bcd49-dwwvf\" (UID: \"bc7e0dd7-f664-44cc-9147-a14e91bf87bf\") " pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:19.934387 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.934367    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d9fb476-32eb-4156-87f3-6a2448202da0-cert\") pod \"llmisvc-controller-manager-74f75ff8c4-wxkhq\" (UID: \"3d9fb476-32eb-4156-87f3-6a2448202da0\") " pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:19.934499 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.934481    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d9d0703-6626-4f35-bbf6-76bef79ba397-cert\") pod \"kserve-controller-manager-57b57d8c6-7zbdq\" (UID: \"2d9d0703-6626-4f35-bbf6-76bef79ba397\") " pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:19.944620 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.944593    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sgnt\" (UniqueName: \"kubernetes.io/projected/bc7e0dd7-f664-44cc-9147-a14e91bf87bf-kube-api-access-7sgnt\") pod \"seaweedfs-64568bcd49-dwwvf\" (UID: \"bc7e0dd7-f664-44cc-9147-a14e91bf87bf\") " pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:19.944698 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.944656    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhh4h\" (UniqueName: \"kubernetes.io/projected/2d9d0703-6626-4f35-bbf6-76bef79ba397-kube-api-access-qhh4h\") pod \"kserve-controller-manager-57b57d8c6-7zbdq\" (UID: \"2d9d0703-6626-4f35-bbf6-76bef79ba397\") " pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:19.945287 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.945270    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-966b2\" (UniqueName: \"kubernetes.io/projected/3d9fb476-32eb-4156-87f3-6a2448202da0-kube-api-access-966b2\") pod \"llmisvc-controller-manager-74f75ff8c4-wxkhq\" (UID: \"3d9fb476-32eb-4156-87f3-6a2448202da0\") " pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:19.995191 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:19.995165    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:20.015212 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.015189    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:20.037923 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.037897    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:20.145699 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.145594    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-7zbdq"]
Jul 09 18:10:20.150176 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:10:20.150140    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9d0703_6626_4f35_bbf6_76bef79ba397.slice/crio-06193c79dde0d28e7eb2e3936c6f59aedc2dc9f3fbc6edf349b1ae2d220772a4 WatchSource:0}: Error finding container 06193c79dde0d28e7eb2e3936c6f59aedc2dc9f3fbc6edf349b1ae2d220772a4: Status 404 returned error can't find the container with id 06193c79dde0d28e7eb2e3936c6f59aedc2dc9f3fbc6edf349b1ae2d220772a4
Jul 09 18:10:20.151662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.151643    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:10:20.171232 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.171208    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"]
Jul 09 18:10:20.175110 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:10:20.175080    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d9fb476_32eb_4156_87f3_6a2448202da0.slice/crio-303644a45e40e27a01c7808dcf944c2b1562d204719cfad5f050dab495c073e4 WatchSource:0}: Error finding container 303644a45e40e27a01c7808dcf944c2b1562d204719cfad5f050dab495c073e4: Status 404 returned error can't find the container with id 303644a45e40e27a01c7808dcf944c2b1562d204719cfad5f050dab495c073e4
Jul 09 18:10:20.197193 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.197173    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-dwwvf"]
Jul 09 18:10:20.199216 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:10:20.199197    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7e0dd7_f664_44cc_9147_a14e91bf87bf.slice/crio-cdb0ab20637d1d119faf93a90983ae35cff0f9fdabf4e15b7b15734c888d61d0 WatchSource:0}: Error finding container cdb0ab20637d1d119faf93a90983ae35cff0f9fdabf4e15b7b15734c888d61d0: Status 404 returned error can't find the container with id cdb0ab20637d1d119faf93a90983ae35cff0f9fdabf4e15b7b15734c888d61d0
Jul 09 18:10:20.626182 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.626146    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-dwwvf" event={"ID":"bc7e0dd7-f664-44cc-9147-a14e91bf87bf","Type":"ContainerStarted","Data":"cdb0ab20637d1d119faf93a90983ae35cff0f9fdabf4e15b7b15734c888d61d0"}
Jul 09 18:10:20.627445 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.627419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq" event={"ID":"2d9d0703-6626-4f35-bbf6-76bef79ba397","Type":"ContainerStarted","Data":"06193c79dde0d28e7eb2e3936c6f59aedc2dc9f3fbc6edf349b1ae2d220772a4"}
Jul 09 18:10:20.628693 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:20.628671    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq" event={"ID":"3d9fb476-32eb-4156-87f3-6a2448202da0","Type":"ContainerStarted","Data":"303644a45e40e27a01c7808dcf944c2b1562d204719cfad5f050dab495c073e4"}
Jul 09 18:10:25.654496 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.654414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq" event={"ID":"2d9d0703-6626-4f35-bbf6-76bef79ba397","Type":"ContainerStarted","Data":"a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f"}
Jul 09 18:10:25.654884 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.654528    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:25.656160 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.656125    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq" event={"ID":"3d9fb476-32eb-4156-87f3-6a2448202da0","Type":"ContainerStarted","Data":"8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e"}
Jul 09 18:10:25.656297 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.656212    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:25.657549 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.657528    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-dwwvf" event={"ID":"bc7e0dd7-f664-44cc-9147-a14e91bf87bf","Type":"ContainerStarted","Data":"2fd69b01887c8f841932a633220124bfbb1f7e5abce5e463ff1ad705e795487f"}
Jul 09 18:10:25.657659 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.657640    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:25.675194 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.675155    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq" podStartSLOduration=1.40639068 podStartE2EDuration="6.675142461s" totalImagesPullingTime="5.268751781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:10:25.674752876 +0000 UTC m=+347.173809623" watchObservedRunningTime="2026-07-09 18:10:25.675142461 +0000 UTC m=+347.174199207"
Jul 09 18:10:25.693968 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.693928    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-dwwvf" podStartSLOduration=1.421598852 podStartE2EDuration="6.693916042s" totalImagesPullingTime="5.27231719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:10:25.692895367 +0000 UTC m=+347.191952116" watchObservedRunningTime="2026-07-09 18:10:25.693916042 +0000 UTC m=+347.192972788"
Jul 09 18:10:25.711026 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:25.710987    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq" podStartSLOduration=1.466559663 podStartE2EDuration="6.710974788s" totalImagesPullingTime="5.244415125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:10:25.710166123 +0000 UTC m=+347.209222870" watchObservedRunningTime="2026-07-09 18:10:25.710974788 +0000 UTC m=+347.210031558"
Jul 09 18:10:31.665128 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:31.665030    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-dwwvf"
Jul 09 18:10:56.664835 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:56.664806    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 18:10:56.667897 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:56.667879    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:10:58.190384 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.190351    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"]
Jul 09 18:10:58.262286 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.262196    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"]
Jul 09 18:10:58.262460 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.262301    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.265492 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.265467    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:10:58.265492 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.265484    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gkw28\""
Jul 09 18:10:58.265668 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.265467    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:10:58.343419 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.343385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.343628 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.343475    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbfp\" (UniqueName: \"kubernetes.io/projected/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-kube-api-access-pdbfp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.343628 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.343522    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.444375 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.444289    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbfp\" (UniqueName: \"kubernetes.io/projected/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-kube-api-access-pdbfp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.444375 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.444339    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.444375 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.444367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.444708 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.444690    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.444781 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.444731    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.453206 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.453177    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbfp\" (UniqueName: \"kubernetes.io/projected/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-kube-api-access-pdbfp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.572216 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.572180    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:10:58.728513 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.728495    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"]
Jul 09 18:10:58.731077 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:10:58.731028    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ffaeae_3aef_4f4a_9e89_617013fcd0c0.slice/crio-3fe338391ce65208d8e1593787fe1426759defdcd7b1aa9e7e5f5c26c96244c1 WatchSource:0}: Error finding container 3fe338391ce65208d8e1593787fe1426759defdcd7b1aa9e7e5f5c26c96244c1: Status 404 returned error can't find the container with id 3fe338391ce65208d8e1593787fe1426759defdcd7b1aa9e7e5f5c26c96244c1
Jul 09 18:10:58.805325 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:58.805298    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh" event={"ID":"97ffaeae-3aef-4f4a-9e89-617013fcd0c0","Type":"ContainerStarted","Data":"3fe338391ce65208d8e1593787fe1426759defdcd7b1aa9e7e5f5c26c96244c1"}
Jul 09 18:10:59.810846 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:59.810751    2569 generic.go:356] "Generic (PLEG): container finished" podID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerID="1d8ce3bdadcb3a8661f3da8fb79718ef01dad63c8d960f958f87d22dbc1509e1" exitCode=0
Jul 09 18:10:59.810846 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:10:59.810802    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh" event={"ID":"97ffaeae-3aef-4f4a-9e89-617013fcd0c0","Type":"ContainerDied","Data":"1d8ce3bdadcb3a8661f3da8fb79718ef01dad63c8d960f958f87d22dbc1509e1"}
Jul 09 18:11:00.817143 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:00.817111    2569 generic.go:356] "Generic (PLEG): container finished" podID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerID="9749a556ea1ffeaf5e981852a520663ff83a1bee6900010bf90e52b5691640a0" exitCode=0
Jul 09 18:11:00.817548 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:00.817203    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh" event={"ID":"97ffaeae-3aef-4f4a-9e89-617013fcd0c0","Type":"ContainerDied","Data":"9749a556ea1ffeaf5e981852a520663ff83a1bee6900010bf90e52b5691640a0"}
Jul 09 18:11:01.824072 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:01.824021    2569 generic.go:356] "Generic (PLEG): container finished" podID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerID="e52012a2b866cbe1ce818e6cd15e76287b56d5d32eb0695108f533101fef23e3" exitCode=0
Jul 09 18:11:01.824430 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:01.824104    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh" event={"ID":"97ffaeae-3aef-4f4a-9e89-617013fcd0c0","Type":"ContainerDied","Data":"e52012a2b866cbe1ce818e6cd15e76287b56d5d32eb0695108f533101fef23e3"}
Jul 09 18:11:02.957477 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:02.957449    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:11:03.083162 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.083078    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdbfp\" (UniqueName: \"kubernetes.io/projected/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-kube-api-access-pdbfp\") pod \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") "
Jul 09 18:11:03.083162 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.083158    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-bundle\") pod \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") "
Jul 09 18:11:03.083343 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.083222    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-util\") pod \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\" (UID: \"97ffaeae-3aef-4f4a-9e89-617013fcd0c0\") "
Jul 09 18:11:03.083886 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.083849    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-bundle" (OuterVolumeSpecName: "bundle") pod "97ffaeae-3aef-4f4a-9e89-617013fcd0c0" (UID: "97ffaeae-3aef-4f4a-9e89-617013fcd0c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:03.085119 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.085097    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-kube-api-access-pdbfp" (OuterVolumeSpecName: "kube-api-access-pdbfp") pod "97ffaeae-3aef-4f4a-9e89-617013fcd0c0" (UID: "97ffaeae-3aef-4f4a-9e89-617013fcd0c0"). InnerVolumeSpecName "kube-api-access-pdbfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:11:03.088690 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.088665    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-util" (OuterVolumeSpecName: "util") pod "97ffaeae-3aef-4f4a-9e89-617013fcd0c0" (UID: "97ffaeae-3aef-4f4a-9e89-617013fcd0c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:03.184184 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.184152    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-util\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:11:03.184184 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.184181    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdbfp\" (UniqueName: \"kubernetes.io/projected/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-kube-api-access-pdbfp\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:11:03.184369 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.184192    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ffaeae-3aef-4f4a-9e89-617013fcd0c0-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:11:03.834982 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.834949    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh"
Jul 09 18:11:03.834982 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.834965    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g64dh" event={"ID":"97ffaeae-3aef-4f4a-9e89-617013fcd0c0","Type":"ContainerDied","Data":"3fe338391ce65208d8e1593787fe1426759defdcd7b1aa9e7e5f5c26c96244c1"}
Jul 09 18:11:03.835243 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:03.835023    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fe338391ce65208d8e1593787fe1426759defdcd7b1aa9e7e5f5c26c96244c1"
Jul 09 18:11:07.909791 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.909756    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"]
Jul 09 18:11:07.910177 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.910111    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerName="util"
Jul 09 18:11:07.910177 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.910123    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerName="util"
Jul 09 18:11:07.910177 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.910131    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerName="pull"
Jul 09 18:11:07.910177 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.910136    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerName="pull"
Jul 09 18:11:07.910177 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.910148    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerName="extract"
Jul 09 18:11:07.910177 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.910153    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerName="extract"
Jul 09 18:11:07.910368 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.910203    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="97ffaeae-3aef-4f4a-9e89-617013fcd0c0" containerName="extract"
Jul 09 18:11:07.912182 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.912166    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"
Jul 09 18:11:07.916662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.916640    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g8r2g\""
Jul 09 18:11:07.916780 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.916642    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 18:11:07.917191 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.917174    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:11:07.929997 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:07.929973    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"]
Jul 09 18:11:08.023920 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.023884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrbxk\" (UniqueName: \"kubernetes.io/projected/3844b392-4ea7-44b0-b6bb-87518eabc39d-kube-api-access-xrbxk\") pod \"cert-manager-operator-controller-manager-684f79c9b9-plf6m\" (UID: \"3844b392-4ea7-44b0-b6bb-87518eabc39d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"
Jul 09 18:11:08.023920 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.023918    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3844b392-4ea7-44b0-b6bb-87518eabc39d-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-plf6m\" (UID: \"3844b392-4ea7-44b0-b6bb-87518eabc39d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"
Jul 09 18:11:08.124694 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.124660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrbxk\" (UniqueName: \"kubernetes.io/projected/3844b392-4ea7-44b0-b6bb-87518eabc39d-kube-api-access-xrbxk\") pod \"cert-manager-operator-controller-manager-684f79c9b9-plf6m\" (UID: \"3844b392-4ea7-44b0-b6bb-87518eabc39d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"
Jul 09 18:11:08.124694 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.124691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3844b392-4ea7-44b0-b6bb-87518eabc39d-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-plf6m\" (UID: \"3844b392-4ea7-44b0-b6bb-87518eabc39d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"
Jul 09 18:11:08.125028 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.125012    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3844b392-4ea7-44b0-b6bb-87518eabc39d-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-plf6m\" (UID: \"3844b392-4ea7-44b0-b6bb-87518eabc39d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"
Jul 09 18:11:08.135936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.135904    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrbxk\" (UniqueName: \"kubernetes.io/projected/3844b392-4ea7-44b0-b6bb-87518eabc39d-kube-api-access-xrbxk\") pod \"cert-manager-operator-controller-manager-684f79c9b9-plf6m\" (UID: \"3844b392-4ea7-44b0-b6bb-87518eabc39d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"
Jul 09 18:11:08.220995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.220912    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"
Jul 09 18:11:08.357629 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.357564    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m"]
Jul 09 18:11:08.360074 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:11:08.360029    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3844b392_4ea7_44b0_b6bb_87518eabc39d.slice/crio-3387caf73c13931920cb92a9c28a98cb09dffcfd2bc69a7aa82053f3f7226e08 WatchSource:0}: Error finding container 3387caf73c13931920cb92a9c28a98cb09dffcfd2bc69a7aa82053f3f7226e08: Status 404 returned error can't find the container with id 3387caf73c13931920cb92a9c28a98cb09dffcfd2bc69a7aa82053f3f7226e08
Jul 09 18:11:08.860075 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:08.860031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m" event={"ID":"3844b392-4ea7-44b0-b6bb-87518eabc39d","Type":"ContainerStarted","Data":"3387caf73c13931920cb92a9c28a98cb09dffcfd2bc69a7aa82053f3f7226e08"}
Jul 09 18:11:09.866069 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:09.866026    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m" event={"ID":"3844b392-4ea7-44b0-b6bb-87518eabc39d","Type":"ContainerStarted","Data":"d79eea5d6d04618d0dfa10fc3ad3fbaf6980937a067c2876137575ad55ec9384"}
Jul 09 18:11:09.904802 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:09.904755    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-plf6m" podStartSLOduration=1.572405121 podStartE2EDuration="2.904738474s" totalImagesPullingTime="1.332333353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:09.904543455 +0000 UTC m=+391.403600201" watchObservedRunningTime="2026-07-09 18:11:09.904738474 +0000 UTC m=+391.403795221"
Jul 09 18:11:15.751577 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.751543    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"]
Jul 09 18:11:15.754289 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.754268    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:15.757960 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.757934    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:11:15.759287 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.759268    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:11:15.764297 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.764279    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gkw28\""
Jul 09 18:11:15.771709 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.771687    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"]
Jul 09 18:11:15.893551 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.893518    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:15.893729 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.893587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:15.893729 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.893649    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhlhg\" (UniqueName: \"kubernetes.io/projected/5cd64df7-7c52-4975-bfb7-cb200cbfa495-kube-api-access-zhlhg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:15.994650 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.994614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:15.994792 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.994668    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhlhg\" (UniqueName: \"kubernetes.io/projected/5cd64df7-7c52-4975-bfb7-cb200cbfa495-kube-api-access-zhlhg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:15.994792 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.994714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:15.995024 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.995000    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:15.995088 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:15.995026    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:16.016857 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:16.016798    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhlhg\" (UniqueName: \"kubernetes.io/projected/5cd64df7-7c52-4975-bfb7-cb200cbfa495-kube-api-access-zhlhg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:16.064319 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:16.064293    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:16.196948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:16.196926    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"]
Jul 09 18:11:16.198899 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:11:16.198862    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd64df7_7c52_4975_bfb7_cb200cbfa495.slice/crio-dc6f86485fc7d823bfa3a5507a694618f449db56c4f335de2b9282b995347c41 WatchSource:0}: Error finding container dc6f86485fc7d823bfa3a5507a694618f449db56c4f335de2b9282b995347c41: Status 404 returned error can't find the container with id dc6f86485fc7d823bfa3a5507a694618f449db56c4f335de2b9282b995347c41
Jul 09 18:11:16.899500 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:16.899459    2569 generic.go:356] "Generic (PLEG): container finished" podID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerID="5f02feda803468c1285aee04351f22132e95714cd22af96a6eff6b599966a962" exitCode=0
Jul 09 18:11:16.899891 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:16.899552    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw" event={"ID":"5cd64df7-7c52-4975-bfb7-cb200cbfa495","Type":"ContainerDied","Data":"5f02feda803468c1285aee04351f22132e95714cd22af96a6eff6b599966a962"}
Jul 09 18:11:16.899891 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:16.899601    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw" event={"ID":"5cd64df7-7c52-4975-bfb7-cb200cbfa495","Type":"ContainerStarted","Data":"dc6f86485fc7d823bfa3a5507a694618f449db56c4f335de2b9282b995347c41"}
Jul 09 18:11:19.916357 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:19.916319    2569 generic.go:356] "Generic (PLEG): container finished" podID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerID="1c7cc1615624afd50bbda019fdd12a6d35f5c69fe51f712e958cbdd6a15023a2" exitCode=0
Jul 09 18:11:19.916740 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:19.916395    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw" event={"ID":"5cd64df7-7c52-4975-bfb7-cb200cbfa495","Type":"ContainerDied","Data":"1c7cc1615624afd50bbda019fdd12a6d35f5c69fe51f712e958cbdd6a15023a2"}
Jul 09 18:11:20.922813 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:20.922780    2569 generic.go:356] "Generic (PLEG): container finished" podID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerID="2702ef31c054bab925a35930a9277649c83d038e0c49caece63b92b98c9e07d2" exitCode=0
Jul 09 18:11:20.923217 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:20.922837    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw" event={"ID":"5cd64df7-7c52-4975-bfb7-cb200cbfa495","Type":"ContainerDied","Data":"2702ef31c054bab925a35930a9277649c83d038e0c49caece63b92b98c9e07d2"}
Jul 09 18:11:22.056240 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.056216    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:22.151765 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.151734    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-util\") pod \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") "
Jul 09 18:11:22.151765 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.151773    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhlhg\" (UniqueName: \"kubernetes.io/projected/5cd64df7-7c52-4975-bfb7-cb200cbfa495-kube-api-access-zhlhg\") pod \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") "
Jul 09 18:11:22.152004 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.151833    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-bundle\") pod \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\" (UID: \"5cd64df7-7c52-4975-bfb7-cb200cbfa495\") "
Jul 09 18:11:22.152304 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.152270    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-bundle" (OuterVolumeSpecName: "bundle") pod "5cd64df7-7c52-4975-bfb7-cb200cbfa495" (UID: "5cd64df7-7c52-4975-bfb7-cb200cbfa495"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:22.153955 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.153928    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cd64df7-7c52-4975-bfb7-cb200cbfa495-kube-api-access-zhlhg" (OuterVolumeSpecName: "kube-api-access-zhlhg") pod "5cd64df7-7c52-4975-bfb7-cb200cbfa495" (UID: "5cd64df7-7c52-4975-bfb7-cb200cbfa495"). InnerVolumeSpecName "kube-api-access-zhlhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:11:22.156487 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.156449    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-util" (OuterVolumeSpecName: "util") pod "5cd64df7-7c52-4975-bfb7-cb200cbfa495" (UID: "5cd64df7-7c52-4975-bfb7-cb200cbfa495"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:22.253218 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.253134    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:11:22.253218 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.253159    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cd64df7-7c52-4975-bfb7-cb200cbfa495-util\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:11:22.253218 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.253168    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhlhg\" (UniqueName: \"kubernetes.io/projected/5cd64df7-7c52-4975-bfb7-cb200cbfa495-kube-api-access-zhlhg\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:11:22.933448 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.933412    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw" event={"ID":"5cd64df7-7c52-4975-bfb7-cb200cbfa495","Type":"ContainerDied","Data":"dc6f86485fc7d823bfa3a5507a694618f449db56c4f335de2b9282b995347c41"}
Jul 09 18:11:22.933448 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.933444    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpfdw"
Jul 09 18:11:22.933684 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:22.933459    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc6f86485fc7d823bfa3a5507a694618f449db56c4f335de2b9282b995347c41"
Jul 09 18:11:45.869077 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.869032    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ccc5db49f-vthh4"]
Jul 09 18:11:45.869674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.869568    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerName="util"
Jul 09 18:11:45.869674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.869588    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerName="util"
Jul 09 18:11:45.869674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.869605    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerName="extract"
Jul 09 18:11:45.869674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.869613    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerName="extract"
Jul 09 18:11:45.869674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.869644    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerName="pull"
Jul 09 18:11:45.869674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.869652    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerName="pull"
Jul 09 18:11:45.869969 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.869744    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cd64df7-7c52-4975-bfb7-cb200cbfa495" containerName="extract"
Jul 09 18:11:45.871997 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.871973    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:45.890015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.889981    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccc5db49f-vthh4"]
Jul 09 18:11:45.966893 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.966854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-trusted-ca-bundle\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:45.967121 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.966925    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtjjm\" (UniqueName: \"kubernetes.io/projected/bd53f15f-139c-4505-96ac-9d8812fe922a-kube-api-access-rtjjm\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:45.967121 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.966957    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-oauth-serving-cert\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:45.967121 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.966984    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-service-ca\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:45.967121 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.967107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-console-config\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:45.967307 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.967145    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd53f15f-139c-4505-96ac-9d8812fe922a-console-serving-cert\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:45.967307 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:45.967211    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd53f15f-139c-4505-96ac-9d8812fe922a-console-oauth-config\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.068271 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.068226    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-service-ca\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.068271 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.068279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-console-config\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.068560 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.068306    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd53f15f-139c-4505-96ac-9d8812fe922a-console-serving-cert\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.068560 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.068335    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd53f15f-139c-4505-96ac-9d8812fe922a-console-oauth-config\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.068560 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.068363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-trusted-ca-bundle\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.068560 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.068417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtjjm\" (UniqueName: \"kubernetes.io/projected/bd53f15f-139c-4505-96ac-9d8812fe922a-kube-api-access-rtjjm\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.068560 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.068452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-oauth-serving-cert\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.069009 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.068986    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-service-ca\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.069234 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.069209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-console-config\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.069311 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.069242    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-trusted-ca-bundle\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.069311 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.069293    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd53f15f-139c-4505-96ac-9d8812fe922a-oauth-serving-cert\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.071015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.070982    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd53f15f-139c-4505-96ac-9d8812fe922a-console-oauth-config\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.071015 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.071003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd53f15f-139c-4505-96ac-9d8812fe922a-console-serving-cert\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.078327 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.078308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtjjm\" (UniqueName: \"kubernetes.io/projected/bd53f15f-139c-4505-96ac-9d8812fe922a-kube-api-access-rtjjm\") pod \"console-6ccc5db49f-vthh4\" (UID: \"bd53f15f-139c-4505-96ac-9d8812fe922a\") " pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.181701 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.181604    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:46.328455 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:46.328429    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccc5db49f-vthh4"]
Jul 09 18:11:46.331142 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:11:46.331108    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd53f15f_139c_4505_96ac_9d8812fe922a.slice/crio-b33b94ff86ca279ba17bebf3523f0bdb037952ecd26f0387455fb4ea904f90e4 WatchSource:0}: Error finding container b33b94ff86ca279ba17bebf3523f0bdb037952ecd26f0387455fb4ea904f90e4: Status 404 returned error can't find the container with id b33b94ff86ca279ba17bebf3523f0bdb037952ecd26f0387455fb4ea904f90e4
Jul 09 18:11:47.047363 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:47.047329    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccc5db49f-vthh4" event={"ID":"bd53f15f-139c-4505-96ac-9d8812fe922a","Type":"ContainerStarted","Data":"984c2309a599440c00fc329ad56790399a594a88a579c419982692a84c9aa9fd"}
Jul 09 18:11:47.047761 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:47.047376    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccc5db49f-vthh4" event={"ID":"bd53f15f-139c-4505-96ac-9d8812fe922a","Type":"ContainerStarted","Data":"b33b94ff86ca279ba17bebf3523f0bdb037952ecd26f0387455fb4ea904f90e4"}
Jul 09 18:11:47.081511 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:47.081461    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ccc5db49f-vthh4" podStartSLOduration=2.081443817 podStartE2EDuration="2.081443817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:47.080024131 +0000 UTC m=+428.579080877" watchObservedRunningTime="2026-07-09 18:11:47.081443817 +0000 UTC m=+428.580500563"
Jul 09 18:11:56.182269 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:56.182228    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:56.182741 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:56.182307    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:56.187469 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:56.187439    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:57.098475 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:57.098437    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ccc5db49f-vthh4"
Jul 09 18:11:57.156261 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:11:57.156224    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc57494b7-vg6qt"]
Jul 09 18:12:10.963916 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.963824    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"]
Jul 09 18:12:10.966426 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.966403    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:10.971907 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.971884    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 18:12:10.973726 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.973552    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 18:12:10.973726 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.973692    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 18:12:10.980753 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.980730    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7jlr6\""
Jul 09 18:12:10.980853 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.980765    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 18:12:10.980982 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.980967    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 18:12:10.984822 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:10.984808    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:12:11.005102 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.005078    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"]
Jul 09 18:12:11.090297 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.090260    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.090549 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.090309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.090549 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.090328    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87whc\" (UniqueName: \"kubernetes.io/projected/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-kube-api-access-87whc\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.090549 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.090413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.090549 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.090456    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.090549 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.090522    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.090549 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.090544    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.191958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.191926    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.192152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.191966    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87whc\" (UniqueName: \"kubernetes.io/projected/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-kube-api-access-87whc\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.192152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.191992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.192152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.192019    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.192152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.192079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.192152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.192103    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.192416 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.192165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.192786 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.192760    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.194403 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.194383    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.194509 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.194428    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.194845 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.194823    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.194906 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.194832    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.205878 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.205851    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.206588 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.206568    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87whc\" (UniqueName: \"kubernetes.io/projected/c949b3ed-0521-4abf-b8e5-8bdc56e1900b-kube-api-access-87whc\") pod \"istiod-openshift-gateway-94bb8fbfd-q6w6h\" (UID: \"c949b3ed-0521-4abf-b8e5-8bdc56e1900b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.276648 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.276566    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:11.420207 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:11.420177    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"]
Jul 09 18:12:11.423682 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:11.423653    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc949b3ed_0521_4abf_b8e5_8bdc56e1900b.slice/crio-896331022b295aff17e2cf96d61b9657899be9a96b025faf31c54bf58fe7fe88 WatchSource:0}: Error finding container 896331022b295aff17e2cf96d61b9657899be9a96b025faf31c54bf58fe7fe88: Status 404 returned error can't find the container with id 896331022b295aff17e2cf96d61b9657899be9a96b025faf31c54bf58fe7fe88
Jul 09 18:12:12.162605 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:12.162571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h" event={"ID":"c949b3ed-0521-4abf-b8e5-8bdc56e1900b","Type":"ContainerStarted","Data":"896331022b295aff17e2cf96d61b9657899be9a96b025faf31c54bf58fe7fe88"}
Jul 09 18:12:14.027892 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:14.027834    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:12:14.028145 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:14.027925    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:12:14.172385 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:14.172346    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h" event={"ID":"c949b3ed-0521-4abf-b8e5-8bdc56e1900b","Type":"ContainerStarted","Data":"6df94cbf8b1bc2a81812ad98e0996a5f5241efdd6e0e9626778f9be1c6121732"}
Jul 09 18:12:14.172559 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:14.172441    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:14.205102 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:14.205035    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h" podStartSLOduration=1.6030605580000001 podStartE2EDuration="4.205020178s" totalImagesPullingTime="2.60195962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:14.203192086 +0000 UTC m=+455.702248860" watchObservedRunningTime="2026-07-09 18:12:14.205020178 +0000 UTC m=+455.704076925"
Jul 09 18:12:15.179235 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:15.179200    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-q6w6h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 18:12:15.179596 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:15.179289    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h" podUID="c949b3ed-0521-4abf-b8e5-8bdc56e1900b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:12:18.178731 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.178700    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q6w6h"
Jul 09 18:12:18.741713 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.741681    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"]
Jul 09 18:12:18.745384 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.745357    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.749647 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.749622    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-572j5\""
Jul 09 18:12:18.753127 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.753258 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753138    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcpgb\" (UniqueName: \"kubernetes.io/projected/fb8342bd-81ef-451a-81a1-8f8fe26e6108-kube-api-access-tcpgb\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.753258 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753159    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.753258 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753174    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.753401 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753290    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.753401 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.753401 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.753523 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753446    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.753523 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.753463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.788735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.788702    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"]
Jul 09 18:12:18.854285 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854247    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854285 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854536 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854306    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854536 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854536 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854454    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854707 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854573    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854707 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcpgb\" (UniqueName: \"kubernetes.io/projected/fb8342bd-81ef-451a-81a1-8f8fe26e6108-kube-api-access-tcpgb\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854707 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854654    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854707 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854914 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854731    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.854914 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.854856    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.855177 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.855148    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.855311 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.855234    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.855311 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.855238    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.856700 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.856679    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.857125 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.857104    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.864203 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.864180    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcpgb\" (UniqueName: \"kubernetes.io/projected/fb8342bd-81ef-451a-81a1-8f8fe26e6108-kube-api-access-tcpgb\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:18.864394 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:18.864373    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb8342bd-81ef-451a-81a1-8f8fe26e6108-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-p4tn9\" (UID: \"fb8342bd-81ef-451a-81a1-8f8fe26e6108\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:19.056162 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:19.056047    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:19.215177 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:19.215156    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"]
Jul 09 18:12:19.217024 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:19.216995    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8342bd_81ef_451a_81a1_8f8fe26e6108.slice/crio-5b3fda7abbf13f60570b413d6fc239f43a9f3c114c7b59bb99618b8a88af4be3 WatchSource:0}: Error finding container 5b3fda7abbf13f60570b413d6fc239f43a9f3c114c7b59bb99618b8a88af4be3: Status 404 returned error can't find the container with id 5b3fda7abbf13f60570b413d6fc239f43a9f3c114c7b59bb99618b8a88af4be3
Jul 09 18:12:20.202645 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:20.202603    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" event={"ID":"fb8342bd-81ef-451a-81a1-8f8fe26e6108","Type":"ContainerStarted","Data":"5b3fda7abbf13f60570b413d6fc239f43a9f3c114c7b59bb99618b8a88af4be3"}
Jul 09 18:12:21.671717 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:21.671669    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:12:21.671998 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:21.671770    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:12:21.671998 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:21.671815    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:12:22.178800 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.178761    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dc57494b7-vg6qt" podUID="51c08cd4-1976-4a62-9398-2ff0f0c6658b" containerName="console" containerID="cri-o://6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a" gracePeriod=15
Jul 09 18:12:22.214807 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.214769    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" event={"ID":"fb8342bd-81ef-451a-81a1-8f8fe26e6108","Type":"ContainerStarted","Data":"6300db07e80393885932896eb21052bf6256e9a5405b6a34f4f50bb1d1832acd"}
Jul 09 18:12:22.241544 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.241487    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podStartSLOduration=1.789581846 podStartE2EDuration="4.241467458s" totalImagesPullingTime="2.451885612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:22.239852811 +0000 UTC m=+463.738909559" watchObservedRunningTime="2026-07-09 18:12:22.241467458 +0000 UTC m=+463.740524206"
Jul 09 18:12:22.431601 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.431574    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:12:22.488948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.488918    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-oauth-serving-cert\") pod \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") "
Jul 09 18:12:22.488948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.488951    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-serving-cert\") pod \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") "
Jul 09 18:12:22.489212 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.488982    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drqk5\" (UniqueName: \"kubernetes.io/projected/51c08cd4-1976-4a62-9398-2ff0f0c6658b-kube-api-access-drqk5\") pod \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") "
Jul 09 18:12:22.489212 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.489047    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-oauth-config\") pod \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") "
Jul 09 18:12:22.489212 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.489113    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-trusted-ca-bundle\") pod \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") "
Jul 09 18:12:22.489212 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.489140    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-config\") pod \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") "
Jul 09 18:12:22.489212 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.489168    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-service-ca\") pod \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\" (UID: \"51c08cd4-1976-4a62-9398-2ff0f0c6658b\") "
Jul 09 18:12:22.489523 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.489492    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51c08cd4-1976-4a62-9398-2ff0f0c6658b" (UID: "51c08cd4-1976-4a62-9398-2ff0f0c6658b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:12:22.489679 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.489651    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-config" (OuterVolumeSpecName: "console-config") pod "51c08cd4-1976-4a62-9398-2ff0f0c6658b" (UID: "51c08cd4-1976-4a62-9398-2ff0f0c6658b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:12:22.489679 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.489666    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "51c08cd4-1976-4a62-9398-2ff0f0c6658b" (UID: "51c08cd4-1976-4a62-9398-2ff0f0c6658b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:12:22.489769 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.489722    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-service-ca" (OuterVolumeSpecName: "service-ca") pod "51c08cd4-1976-4a62-9398-2ff0f0c6658b" (UID: "51c08cd4-1976-4a62-9398-2ff0f0c6658b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:12:22.491235 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.491213    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51c08cd4-1976-4a62-9398-2ff0f0c6658b" (UID: "51c08cd4-1976-4a62-9398-2ff0f0c6658b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:12:22.491652 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.491630    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c08cd4-1976-4a62-9398-2ff0f0c6658b-kube-api-access-drqk5" (OuterVolumeSpecName: "kube-api-access-drqk5") pod "51c08cd4-1976-4a62-9398-2ff0f0c6658b" (UID: "51c08cd4-1976-4a62-9398-2ff0f0c6658b"). InnerVolumeSpecName "kube-api-access-drqk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:12:22.491725 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.491631    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51c08cd4-1976-4a62-9398-2ff0f0c6658b" (UID: "51c08cd4-1976-4a62-9398-2ff0f0c6658b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:12:22.590279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.590240    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-service-ca\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:22.590279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.590271    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-oauth-serving-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:22.590279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.590281    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-serving-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:22.590279 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.590290    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drqk5\" (UniqueName: \"kubernetes.io/projected/51c08cd4-1976-4a62-9398-2ff0f0c6658b-kube-api-access-drqk5\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:22.590536 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.590298    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-oauth-config\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:22.590536 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.590308    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-trusted-ca-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:22.590536 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:22.590316    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51c08cd4-1976-4a62-9398-2ff0f0c6658b-console-config\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:23.057176 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.057134    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:23.062154 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.062126    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:23.220960 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.220932    2569 generic.go:356] "Generic (PLEG): container finished" podID="51c08cd4-1976-4a62-9398-2ff0f0c6658b" containerID="6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a" exitCode=0
Jul 09 18:12:23.221152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.220987    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc57494b7-vg6qt"
Jul 09 18:12:23.221152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.221015    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc57494b7-vg6qt" event={"ID":"51c08cd4-1976-4a62-9398-2ff0f0c6658b","Type":"ContainerDied","Data":"6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a"}
Jul 09 18:12:23.221152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.221081    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc57494b7-vg6qt" event={"ID":"51c08cd4-1976-4a62-9398-2ff0f0c6658b","Type":"ContainerDied","Data":"d21f088c0b5c0c44b09a912ac883b32a5bcfb711b9ea0581870f04b05dfed720"}
Jul 09 18:12:23.221152 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.221104    2569 scope.go:117] "RemoveContainer" containerID="6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a"
Jul 09 18:12:23.221488 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.221469    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:23.222704 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.222683    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:12:23.229632 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.229609    2569 scope.go:117] "RemoveContainer" containerID="6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a"
Jul 09 18:12:23.229898 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:12:23.229877    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a\": container with ID starting with 6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a not found: ID does not exist" containerID="6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a"
Jul 09 18:12:23.229947 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.229908    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a"} err="failed to get container status \"6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a\": rpc error: code = NotFound desc = could not find container \"6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a\": container with ID starting with 6a561ed36a14f36e1cd3e9e9ee5409600a10395ddcea75e59875b5d25504de8a not found: ID does not exist"
Jul 09 18:12:23.275438 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.275408    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc57494b7-vg6qt"]
Jul 09 18:12:23.283401 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:23.283379    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc57494b7-vg6qt"]
Jul 09 18:12:25.121971 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:25.121937    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51c08cd4-1976-4a62-9398-2ff0f0c6658b" path="/var/lib/kubelet/pods/51c08cd4-1976-4a62-9398-2ff0f0c6658b/volumes"
Jul 09 18:12:27.344331 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.344304    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"]
Jul 09 18:12:27.344703 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.344647    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c08cd4-1976-4a62-9398-2ff0f0c6658b" containerName="console"
Jul 09 18:12:27.344703 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.344657    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c08cd4-1976-4a62-9398-2ff0f0c6658b" containerName="console"
Jul 09 18:12:27.344781 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.344718    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c08cd4-1976-4a62-9398-2ff0f0c6658b" containerName="console"
Jul 09 18:12:27.349452 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.349435    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.352435 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.352418    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:12:27.353485 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.353468    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:12:27.353485 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.353477    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gkw28\""
Jul 09 18:12:27.358454 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.358431    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"]
Jul 09 18:12:27.433662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.433617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.433851 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.433696    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csm5j\" (UniqueName: \"kubernetes.io/projected/b3c31267-0a11-4069-8aff-c0fda32d1204-kube-api-access-csm5j\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.433851 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.433722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.468203 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.468172    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"]
Jul 09 18:12:27.471767 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.471751    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.501293 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.501260    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"]
Jul 09 18:12:27.534755 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.534722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.535013 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.534994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrgm\" (UniqueName: \"kubernetes.io/projected/ba8f2975-e188-444e-bded-e04f938e4951-kube-api-access-vdrgm\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.535221 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.535191    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.535406 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.535388    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csm5j\" (UniqueName: \"kubernetes.io/projected/b3c31267-0a11-4069-8aff-c0fda32d1204-kube-api-access-csm5j\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.535512 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.535499    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.535624 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.535609    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.536172 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.536151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.536632 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.536612    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.548444 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.548417    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csm5j\" (UniqueName: \"kubernetes.io/projected/b3c31267-0a11-4069-8aff-c0fda32d1204-kube-api-access-csm5j\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.557314 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.557290    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"]
Jul 09 18:12:27.560927 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.560913    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.569872 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.569850    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"]
Jul 09 18:12:27.629169 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.629093    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"]
Jul 09 18:12:27.632679 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.632664    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.636253 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.636226    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.636344 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.636275    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrtn\" (UniqueName: \"kubernetes.io/projected/9ba669d5-c474-4091-8601-143cf3d588c9-kube-api-access-jxrtn\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.636399 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.636347    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.636451 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.636418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrgm\" (UniqueName: \"kubernetes.io/projected/ba8f2975-e188-444e-bded-e04f938e4951-kube-api-access-vdrgm\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.636516 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.636499    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.636569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.636526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.636619 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.636602    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.636669 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.636628    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.642566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.642543    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"]
Jul 09 18:12:27.645548 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.645525    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrgm\" (UniqueName: \"kubernetes.io/projected/ba8f2975-e188-444e-bded-e04f938e4951-kube-api-access-vdrgm\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.658896 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.658872    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:27.737610 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.737580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.737775 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.737625    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrtn\" (UniqueName: \"kubernetes.io/projected/9ba669d5-c474-4091-8601-143cf3d588c9-kube-api-access-jxrtn\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.737775 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.737701    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkkbh\" (UniqueName: \"kubernetes.io/projected/480a9927-48c2-4729-99fc-4b61ceb1c589-kube-api-access-bkkbh\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.737775 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.737763    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.737892 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.737874    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.737935 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.737902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.738231 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.738212    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.738266 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.738234    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.748857 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.748831    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrtn\" (UniqueName: \"kubernetes.io/projected/9ba669d5-c474-4091-8601-143cf3d588c9-kube-api-access-jxrtn\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.791078 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.782217    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:27.819024 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.818999    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"]
Jul 09 18:12:27.820573 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:27.820541    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c31267_0a11_4069_8aff_c0fda32d1204.slice/crio-f82f684e2120a4314abe7d16816b3ee0febf8473d5e1a71053807c1ccd12aef7 WatchSource:0}: Error finding container f82f684e2120a4314abe7d16816b3ee0febf8473d5e1a71053807c1ccd12aef7: Status 404 returned error can't find the container with id f82f684e2120a4314abe7d16816b3ee0febf8473d5e1a71053807c1ccd12aef7
Jul 09 18:12:27.839089 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.839048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkkbh\" (UniqueName: \"kubernetes.io/projected/480a9927-48c2-4729-99fc-4b61ceb1c589-kube-api-access-bkkbh\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.839171 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.839124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.839229 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.839215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.839494 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.839476    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.839572 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.839516    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.851000 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.850968    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkkbh\" (UniqueName: \"kubernetes.io/projected/480a9927-48c2-4729-99fc-4b61ceb1c589-kube-api-access-bkkbh\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.870868 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.870838    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:27.939320 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.939021    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"]
Jul 09 18:12:27.942773 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:27.942742    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:27.974778 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:27.974743    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8f2975_e188_444e_bded_e04f938e4951.slice/crio-8cd9c529be4338b49f556a7514c8074f0b59ce44f641a7d65dfca26a729ed2bd WatchSource:0}: Error finding container 8cd9c529be4338b49f556a7514c8074f0b59ce44f641a7d65dfca26a729ed2bd: Status 404 returned error can't find the container with id 8cd9c529be4338b49f556a7514c8074f0b59ce44f641a7d65dfca26a729ed2bd
Jul 09 18:12:28.042692 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.042474    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"]
Jul 09 18:12:28.045734 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:28.045705    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba669d5_c474_4091_8601_143cf3d588c9.slice/crio-19ba8a93344e2bd9a3f5413f1d72c14227d97ab7b6355104f40211b0e1064d64 WatchSource:0}: Error finding container 19ba8a93344e2bd9a3f5413f1d72c14227d97ab7b6355104f40211b0e1064d64: Status 404 returned error can't find the container with id 19ba8a93344e2bd9a3f5413f1d72c14227d97ab7b6355104f40211b0e1064d64
Jul 09 18:12:28.123710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.123686    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"]
Jul 09 18:12:28.214901 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:28.214870    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480a9927_48c2_4729_99fc_4b61ceb1c589.slice/crio-b0a2fd8f83534ef04aa26d16a965527276ea96a5b9475360eeb62ce5c2e5f887 WatchSource:0}: Error finding container b0a2fd8f83534ef04aa26d16a965527276ea96a5b9475360eeb62ce5c2e5f887: Status 404 returned error can't find the container with id b0a2fd8f83534ef04aa26d16a965527276ea96a5b9475360eeb62ce5c2e5f887
Jul 09 18:12:28.248710 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.248687    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerID="b1d0790c45480c345e90540466df791615b0c6b8dbfe8114d0aee472b70eb61a" exitCode=0
Jul 09 18:12:28.248834 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.248769    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7" event={"ID":"b3c31267-0a11-4069-8aff-c0fda32d1204","Type":"ContainerDied","Data":"b1d0790c45480c345e90540466df791615b0c6b8dbfe8114d0aee472b70eb61a"}
Jul 09 18:12:28.248834 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.248810    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7" event={"ID":"b3c31267-0a11-4069-8aff-c0fda32d1204","Type":"ContainerStarted","Data":"f82f684e2120a4314abe7d16816b3ee0febf8473d5e1a71053807c1ccd12aef7"}
Jul 09 18:12:28.250114 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.250088    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj" event={"ID":"480a9927-48c2-4729-99fc-4b61ceb1c589","Type":"ContainerStarted","Data":"b0a2fd8f83534ef04aa26d16a965527276ea96a5b9475360eeb62ce5c2e5f887"}
Jul 09 18:12:28.251892 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.251864    2569 generic.go:356] "Generic (PLEG): container finished" podID="9ba669d5-c474-4091-8601-143cf3d588c9" containerID="3267bb805d64d8a7f4ef3b66cc51036424552945518ef85b03442edd1f589b00" exitCode=0
Jul 09 18:12:28.251988 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.251904    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn" event={"ID":"9ba669d5-c474-4091-8601-143cf3d588c9","Type":"ContainerDied","Data":"3267bb805d64d8a7f4ef3b66cc51036424552945518ef85b03442edd1f589b00"}
Jul 09 18:12:28.251988 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.251957    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn" event={"ID":"9ba669d5-c474-4091-8601-143cf3d588c9","Type":"ContainerStarted","Data":"19ba8a93344e2bd9a3f5413f1d72c14227d97ab7b6355104f40211b0e1064d64"}
Jul 09 18:12:28.253757 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.253731    2569 generic.go:356] "Generic (PLEG): container finished" podID="ba8f2975-e188-444e-bded-e04f938e4951" containerID="bd20a48d7ddb92a4cc42c34275eaaed1ca96d7d1aaa42f4f417336e89f02161e" exitCode=0
Jul 09 18:12:28.253842 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.253805    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf" event={"ID":"ba8f2975-e188-444e-bded-e04f938e4951","Type":"ContainerDied","Data":"bd20a48d7ddb92a4cc42c34275eaaed1ca96d7d1aaa42f4f417336e89f02161e"}
Jul 09 18:12:28.253894 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:28.253846    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf" event={"ID":"ba8f2975-e188-444e-bded-e04f938e4951","Type":"ContainerStarted","Data":"8cd9c529be4338b49f556a7514c8074f0b59ce44f641a7d65dfca26a729ed2bd"}
Jul 09 18:12:29.260876 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:29.260847    2569 generic.go:356] "Generic (PLEG): container finished" podID="9ba669d5-c474-4091-8601-143cf3d588c9" containerID="f9b8279727f190f3fa4bd4d3323c583f6d9e79ce6054cd53a2de362e599d6e72" exitCode=0
Jul 09 18:12:29.261271 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:29.260940    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn" event={"ID":"9ba669d5-c474-4091-8601-143cf3d588c9","Type":"ContainerDied","Data":"f9b8279727f190f3fa4bd4d3323c583f6d9e79ce6054cd53a2de362e599d6e72"}
Jul 09 18:12:29.262873 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:29.262851    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerID="cb8bf039f5855793d14967fb595540edf700613fb11d643ef87a445e98ce7ff2" exitCode=0
Jul 09 18:12:29.262995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:29.262935    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7" event={"ID":"b3c31267-0a11-4069-8aff-c0fda32d1204","Type":"ContainerDied","Data":"cb8bf039f5855793d14967fb595540edf700613fb11d643ef87a445e98ce7ff2"}
Jul 09 18:12:29.264446 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:29.264428    2569 generic.go:356] "Generic (PLEG): container finished" podID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerID="192d0a21fbef76c9c8bae9d39e7edee0f99d0ca293686c088668a76157f3e097" exitCode=0
Jul 09 18:12:29.264548 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:29.264453    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj" event={"ID":"480a9927-48c2-4729-99fc-4b61ceb1c589","Type":"ContainerDied","Data":"192d0a21fbef76c9c8bae9d39e7edee0f99d0ca293686c088668a76157f3e097"}
Jul 09 18:12:30.271000 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:30.270971    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerID="7d614cc5aa1d03be2bac38365433652fe8aafd0ce428c5e7937ad6152177b0e7" exitCode=0
Jul 09 18:12:30.271399 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:30.271045    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7" event={"ID":"b3c31267-0a11-4069-8aff-c0fda32d1204","Type":"ContainerDied","Data":"7d614cc5aa1d03be2bac38365433652fe8aafd0ce428c5e7937ad6152177b0e7"}
Jul 09 18:12:30.272868 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:30.272842    2569 generic.go:356] "Generic (PLEG): container finished" podID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerID="921aa84c7c3a9ed03d2f4d5e155c7d7dcdeb58169a925c306df319839e6d0873" exitCode=0
Jul 09 18:12:30.272981 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:30.272914    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj" event={"ID":"480a9927-48c2-4729-99fc-4b61ceb1c589","Type":"ContainerDied","Data":"921aa84c7c3a9ed03d2f4d5e155c7d7dcdeb58169a925c306df319839e6d0873"}
Jul 09 18:12:30.275407 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:30.275379    2569 generic.go:356] "Generic (PLEG): container finished" podID="9ba669d5-c474-4091-8601-143cf3d588c9" containerID="b922ba0be5265787a12dd6c4ea7034dac7ad64874ce0c8bee0710c80e9eede15" exitCode=0
Jul 09 18:12:30.275509 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:30.275470    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn" event={"ID":"9ba669d5-c474-4091-8601-143cf3d588c9","Type":"ContainerDied","Data":"b922ba0be5265787a12dd6c4ea7034dac7ad64874ce0c8bee0710c80e9eede15"}
Jul 09 18:12:30.277235 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:30.277205    2569 generic.go:356] "Generic (PLEG): container finished" podID="ba8f2975-e188-444e-bded-e04f938e4951" containerID="184ccf773f7e69d5da38607dea86081bf38b8a646bac9e08b32fc23af64949b1" exitCode=0
Jul 09 18:12:30.277324 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:30.277279    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf" event={"ID":"ba8f2975-e188-444e-bded-e04f938e4951","Type":"ContainerDied","Data":"184ccf773f7e69d5da38607dea86081bf38b8a646bac9e08b32fc23af64949b1"}
Jul 09 18:12:31.284780 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.284745    2569 generic.go:356] "Generic (PLEG): container finished" podID="ba8f2975-e188-444e-bded-e04f938e4951" containerID="7bc852dcd64b14a510b49713305ad3bac42f239023a3358f51fe161ae2d2f254" exitCode=0
Jul 09 18:12:31.285288 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.284830    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf" event={"ID":"ba8f2975-e188-444e-bded-e04f938e4951","Type":"ContainerDied","Data":"7bc852dcd64b14a510b49713305ad3bac42f239023a3358f51fe161ae2d2f254"}
Jul 09 18:12:31.287038 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.287013    2569 generic.go:356] "Generic (PLEG): container finished" podID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerID="1b972629bbcac0a1fda36936d82ff3913d6f547e0d786d54695e445e643e851d" exitCode=0
Jul 09 18:12:31.287173 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.287094    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj" event={"ID":"480a9927-48c2-4729-99fc-4b61ceb1c589","Type":"ContainerDied","Data":"1b972629bbcac0a1fda36936d82ff3913d6f547e0d786d54695e445e643e851d"}
Jul 09 18:12:31.426815 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.426789    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:31.460269 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.460244    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:31.469302 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.469280    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxrtn\" (UniqueName: \"kubernetes.io/projected/9ba669d5-c474-4091-8601-143cf3d588c9-kube-api-access-jxrtn\") pod \"9ba669d5-c474-4091-8601-143cf3d588c9\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") "
Jul 09 18:12:31.469412 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.469314    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-util\") pod \"9ba669d5-c474-4091-8601-143cf3d588c9\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") "
Jul 09 18:12:31.469412 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.469394    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-bundle\") pod \"9ba669d5-c474-4091-8601-143cf3d588c9\" (UID: \"9ba669d5-c474-4091-8601-143cf3d588c9\") "
Jul 09 18:12:31.469863 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.469836    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-bundle" (OuterVolumeSpecName: "bundle") pod "9ba669d5-c474-4091-8601-143cf3d588c9" (UID: "9ba669d5-c474-4091-8601-143cf3d588c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:12:31.471351 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.471329    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba669d5-c474-4091-8601-143cf3d588c9-kube-api-access-jxrtn" (OuterVolumeSpecName: "kube-api-access-jxrtn") pod "9ba669d5-c474-4091-8601-143cf3d588c9" (UID: "9ba669d5-c474-4091-8601-143cf3d588c9"). InnerVolumeSpecName "kube-api-access-jxrtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:12:31.474815 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.474782    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-util" (OuterVolumeSpecName: "util") pod "9ba669d5-c474-4091-8601-143cf3d588c9" (UID: "9ba669d5-c474-4091-8601-143cf3d588c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:12:31.569969 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.569940    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-util\") pod \"b3c31267-0a11-4069-8aff-c0fda32d1204\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") "
Jul 09 18:12:31.570134 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.569990    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csm5j\" (UniqueName: \"kubernetes.io/projected/b3c31267-0a11-4069-8aff-c0fda32d1204-kube-api-access-csm5j\") pod \"b3c31267-0a11-4069-8aff-c0fda32d1204\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") "
Jul 09 18:12:31.570197 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.570149    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-bundle\") pod \"b3c31267-0a11-4069-8aff-c0fda32d1204\" (UID: \"b3c31267-0a11-4069-8aff-c0fda32d1204\") "
Jul 09 18:12:31.570378 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.570364    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:31.570446 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.570380    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxrtn\" (UniqueName: \"kubernetes.io/projected/9ba669d5-c474-4091-8601-143cf3d588c9-kube-api-access-jxrtn\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:31.570446 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.570391    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba669d5-c474-4091-8601-143cf3d588c9-util\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:31.570722 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.570697    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-bundle" (OuterVolumeSpecName: "bundle") pod "b3c31267-0a11-4069-8aff-c0fda32d1204" (UID: "b3c31267-0a11-4069-8aff-c0fda32d1204"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:12:31.572108 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.572085    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c31267-0a11-4069-8aff-c0fda32d1204-kube-api-access-csm5j" (OuterVolumeSpecName: "kube-api-access-csm5j") pod "b3c31267-0a11-4069-8aff-c0fda32d1204" (UID: "b3c31267-0a11-4069-8aff-c0fda32d1204"). InnerVolumeSpecName "kube-api-access-csm5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:12:31.575384 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.575360    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-util" (OuterVolumeSpecName: "util") pod "b3c31267-0a11-4069-8aff-c0fda32d1204" (UID: "b3c31267-0a11-4069-8aff-c0fda32d1204"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:12:31.670913 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.670886    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-util\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:31.670913 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.670910    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csm5j\" (UniqueName: \"kubernetes.io/projected/b3c31267-0a11-4069-8aff-c0fda32d1204-kube-api-access-csm5j\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:31.670913 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:31.670919    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c31267-0a11-4069-8aff-c0fda32d1204-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:32.293881 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.293853    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn"
Jul 09 18:12:32.294365 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.293878    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef2wwsn" event={"ID":"9ba669d5-c474-4091-8601-143cf3d588c9","Type":"ContainerDied","Data":"19ba8a93344e2bd9a3f5413f1d72c14227d97ab7b6355104f40211b0e1064d64"}
Jul 09 18:12:32.294365 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.293927    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19ba8a93344e2bd9a3f5413f1d72c14227d97ab7b6355104f40211b0e1064d64"
Jul 09 18:12:32.295742 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.295726    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7"
Jul 09 18:12:32.295871 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.295765    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76kgkd7" event={"ID":"b3c31267-0a11-4069-8aff-c0fda32d1204","Type":"ContainerDied","Data":"f82f684e2120a4314abe7d16816b3ee0febf8473d5e1a71053807c1ccd12aef7"}
Jul 09 18:12:32.295871 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.295804    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f82f684e2120a4314abe7d16816b3ee0febf8473d5e1a71053807c1ccd12aef7"
Jul 09 18:12:32.459315 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.459294    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:32.461430 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.461408    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:32.581825 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.581790    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-bundle\") pod \"ba8f2975-e188-444e-bded-e04f938e4951\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") "
Jul 09 18:12:32.581982 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.581854    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-util\") pod \"480a9927-48c2-4729-99fc-4b61ceb1c589\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") "
Jul 09 18:12:32.581982 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.581945    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-util\") pod \"ba8f2975-e188-444e-bded-e04f938e4951\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") "
Jul 09 18:12:32.582079 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.581983    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-bundle\") pod \"480a9927-48c2-4729-99fc-4b61ceb1c589\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") "
Jul 09 18:12:32.582079 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.582041    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdrgm\" (UniqueName: \"kubernetes.io/projected/ba8f2975-e188-444e-bded-e04f938e4951-kube-api-access-vdrgm\") pod \"ba8f2975-e188-444e-bded-e04f938e4951\" (UID: \"ba8f2975-e188-444e-bded-e04f938e4951\") "
Jul 09 18:12:32.582184 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.582094    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkkbh\" (UniqueName: \"kubernetes.io/projected/480a9927-48c2-4729-99fc-4b61ceb1c589-kube-api-access-bkkbh\") pod \"480a9927-48c2-4729-99fc-4b61ceb1c589\" (UID: \"480a9927-48c2-4729-99fc-4b61ceb1c589\") "
Jul 09 18:12:32.582445 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.582414    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-bundle" (OuterVolumeSpecName: "bundle") pod "ba8f2975-e188-444e-bded-e04f938e4951" (UID: "ba8f2975-e188-444e-bded-e04f938e4951"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:12:32.582695 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.582650    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-bundle" (OuterVolumeSpecName: "bundle") pod "480a9927-48c2-4729-99fc-4b61ceb1c589" (UID: "480a9927-48c2-4729-99fc-4b61ceb1c589"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:12:32.584242 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.584214    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba8f2975-e188-444e-bded-e04f938e4951-kube-api-access-vdrgm" (OuterVolumeSpecName: "kube-api-access-vdrgm") pod "ba8f2975-e188-444e-bded-e04f938e4951" (UID: "ba8f2975-e188-444e-bded-e04f938e4951"). InnerVolumeSpecName "kube-api-access-vdrgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:12:32.584463 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.584439    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/480a9927-48c2-4729-99fc-4b61ceb1c589-kube-api-access-bkkbh" (OuterVolumeSpecName: "kube-api-access-bkkbh") pod "480a9927-48c2-4729-99fc-4b61ceb1c589" (UID: "480a9927-48c2-4729-99fc-4b61ceb1c589"). InnerVolumeSpecName "kube-api-access-bkkbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:12:32.590887 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.590859    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-util" (OuterVolumeSpecName: "util") pod "480a9927-48c2-4729-99fc-4b61ceb1c589" (UID: "480a9927-48c2-4729-99fc-4b61ceb1c589"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:12:32.591082 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.591049    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-util" (OuterVolumeSpecName: "util") pod "ba8f2975-e188-444e-bded-e04f938e4951" (UID: "ba8f2975-e188-444e-bded-e04f938e4951"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:12:32.682958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.682916    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-util\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:32.682958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.682953    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:32.682958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.682963    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdrgm\" (UniqueName: \"kubernetes.io/projected/ba8f2975-e188-444e-bded-e04f938e4951-kube-api-access-vdrgm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:32.682958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.682973    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkkbh\" (UniqueName: \"kubernetes.io/projected/480a9927-48c2-4729-99fc-4b61ceb1c589-kube-api-access-bkkbh\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:32.683273 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.682982    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba8f2975-e188-444e-bded-e04f938e4951-bundle\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:32.683273 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:32.682990    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/480a9927-48c2-4729-99fc-4b61ceb1c589-util\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:12:33.302479 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:33.302451    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj"
Jul 09 18:12:33.302479 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:33.302472    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcab5r7tj" event={"ID":"480a9927-48c2-4729-99fc-4b61ceb1c589","Type":"ContainerDied","Data":"b0a2fd8f83534ef04aa26d16a965527276ea96a5b9475360eeb62ce5c2e5f887"}
Jul 09 18:12:33.302960 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:33.302514    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0a2fd8f83534ef04aa26d16a965527276ea96a5b9475360eeb62ce5c2e5f887"
Jul 09 18:12:33.304771 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:33.304727    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf" event={"ID":"ba8f2975-e188-444e-bded-e04f938e4951","Type":"ContainerDied","Data":"8cd9c529be4338b49f556a7514c8074f0b59ce44f641a7d65dfca26a729ed2bd"}
Jul 09 18:12:33.304896 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:33.304781    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cd9c529be4338b49f556a7514c8074f0b59ce44f641a7d65dfca26a729ed2bd"
Jul 09 18:12:33.304896 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:33.304783    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff369ztlf"
Jul 09 18:12:40.858201 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858162    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-586ks"]
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858513    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba8f2975-e188-444e-bded-e04f938e4951" containerName="util"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858524    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba8f2975-e188-444e-bded-e04f938e4951" containerName="util"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858534    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerName="extract"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858539    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerName="extract"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858545    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerName="pull"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858551    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerName="pull"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858556    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba669d5-c474-4091-8601-143cf3d588c9" containerName="pull"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858562    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba669d5-c474-4091-8601-143cf3d588c9" containerName="pull"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858573    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerName="util"
Jul 09 18:12:40.858574 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858578    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerName="util"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858585    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858590    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858601    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba669d5-c474-4091-8601-143cf3d588c9" containerName="util"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858606    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba669d5-c474-4091-8601-143cf3d588c9" containerName="util"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858614    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba669d5-c474-4091-8601-143cf3d588c9" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858619    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba669d5-c474-4091-8601-143cf3d588c9" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858625    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba8f2975-e188-444e-bded-e04f938e4951" containerName="pull"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858630    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba8f2975-e188-444e-bded-e04f938e4951" containerName="pull"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858635    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba8f2975-e188-444e-bded-e04f938e4951" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858640    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba8f2975-e188-444e-bded-e04f938e4951" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858650    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerName="pull"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858654    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerName="pull"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858661    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerName="util"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858665    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerName="util"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858714    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c31267-0a11-4069-8aff-c0fda32d1204" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858721    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="480a9927-48c2-4729-99fc-4b61ceb1c589" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858729    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba8f2975-e188-444e-bded-e04f938e4951" containerName="extract"
Jul 09 18:12:40.858858 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.858736    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ba669d5-c474-4091-8601-143cf3d588c9" containerName="extract"
Jul 09 18:12:40.862946 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.862929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-586ks"
Jul 09 18:12:40.865840 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.865814    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 18:12:40.865987 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.865875    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mkqjw\""
Jul 09 18:12:40.867069 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.867036    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 18:12:40.872866 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.872841    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-586ks"]
Jul 09 18:12:40.958933 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:40.958894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ccrg\" (UniqueName: \"kubernetes.io/projected/6991c4b5-7992-4b82-8f55-2bb84422dbba-kube-api-access-4ccrg\") pod \"authorino-operator-6d85f6564-586ks\" (UID: \"6991c4b5-7992-4b82-8f55-2bb84422dbba\") " pod="kuadrant-system/authorino-operator-6d85f6564-586ks"
Jul 09 18:12:41.059394 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:41.059357    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ccrg\" (UniqueName: \"kubernetes.io/projected/6991c4b5-7992-4b82-8f55-2bb84422dbba-kube-api-access-4ccrg\") pod \"authorino-operator-6d85f6564-586ks\" (UID: \"6991c4b5-7992-4b82-8f55-2bb84422dbba\") " pod="kuadrant-system/authorino-operator-6d85f6564-586ks"
Jul 09 18:12:41.074857 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:41.074819    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ccrg\" (UniqueName: \"kubernetes.io/projected/6991c4b5-7992-4b82-8f55-2bb84422dbba-kube-api-access-4ccrg\") pod \"authorino-operator-6d85f6564-586ks\" (UID: \"6991c4b5-7992-4b82-8f55-2bb84422dbba\") " pod="kuadrant-system/authorino-operator-6d85f6564-586ks"
Jul 09 18:12:41.174426 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:41.174340    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-586ks"
Jul 09 18:12:41.321678 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:41.321646    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-586ks"]
Jul 09 18:12:41.322276 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:41.322239    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6991c4b5_7992_4b82_8f55_2bb84422dbba.slice/crio-de73c18026355f5772cab250bce57cd53ad3e5c0ad49ccbc5d14643e0e6b6f78 WatchSource:0}: Error finding container de73c18026355f5772cab250bce57cd53ad3e5c0ad49ccbc5d14643e0e6b6f78: Status 404 returned error can't find the container with id de73c18026355f5772cab250bce57cd53ad3e5c0ad49ccbc5d14643e0e6b6f78
Jul 09 18:12:41.349011 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:41.348975    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-586ks" event={"ID":"6991c4b5-7992-4b82-8f55-2bb84422dbba","Type":"ContainerStarted","Data":"de73c18026355f5772cab250bce57cd53ad3e5c0ad49ccbc5d14643e0e6b6f78"}
Jul 09 18:12:44.368906 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:44.368867    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-586ks" event={"ID":"6991c4b5-7992-4b82-8f55-2bb84422dbba","Type":"ContainerStarted","Data":"57f0ee0ed1b513259eed4acc07545b0a5b6e24cad189fb3f3b21082e0120d644"}
Jul 09 18:12:44.369431 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:44.368941    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d85f6564-586ks"
Jul 09 18:12:44.408354 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:44.408299    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d85f6564-586ks" podStartSLOduration=2.024068734 podStartE2EDuration="4.408283268s" totalImagesPullingTime="2.384214534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:44.406674841 +0000 UTC m=+485.905731588" watchObservedRunningTime="2026-07-09 18:12:44.408283268 +0000 UTC m=+485.907340015"
Jul 09 18:12:45.306520 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.306482    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"]
Jul 09 18:12:45.309517 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.309498    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"
Jul 09 18:12:45.313677 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.313654    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 18:12:45.313832 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.313748    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tfkkt\""
Jul 09 18:12:45.325213 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.325178    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"]
Jul 09 18:12:45.401891 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.401855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhjp\" (UniqueName: \"kubernetes.io/projected/02100c7b-b225-4c38-9549-e00493058a7a-kube-api-access-bdhjp\") pod \"dns-operator-controller-manager-65b49595d7-vckrl\" (UID: \"02100c7b-b225-4c38-9549-e00493058a7a\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"
Jul 09 18:12:45.503240 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.503203    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhjp\" (UniqueName: \"kubernetes.io/projected/02100c7b-b225-4c38-9549-e00493058a7a-kube-api-access-bdhjp\") pod \"dns-operator-controller-manager-65b49595d7-vckrl\" (UID: \"02100c7b-b225-4c38-9549-e00493058a7a\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"
Jul 09 18:12:45.515575 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.515545    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhjp\" (UniqueName: \"kubernetes.io/projected/02100c7b-b225-4c38-9549-e00493058a7a-kube-api-access-bdhjp\") pod \"dns-operator-controller-manager-65b49595d7-vckrl\" (UID: \"02100c7b-b225-4c38-9549-e00493058a7a\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"
Jul 09 18:12:45.620547 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.620507    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"
Jul 09 18:12:45.764677 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:45.764654    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"]
Jul 09 18:12:45.767426 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:45.767395    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02100c7b_b225_4c38_9549_e00493058a7a.slice/crio-af740df3c9d2199e26b5e95f5d45db39dcd4e3b459eb5f1c47e65494dc2ad1f0 WatchSource:0}: Error finding container af740df3c9d2199e26b5e95f5d45db39dcd4e3b459eb5f1c47e65494dc2ad1f0: Status 404 returned error can't find the container with id af740df3c9d2199e26b5e95f5d45db39dcd4e3b459eb5f1c47e65494dc2ad1f0
Jul 09 18:12:46.380705 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:46.380672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl" event={"ID":"02100c7b-b225-4c38-9549-e00493058a7a","Type":"ContainerStarted","Data":"af740df3c9d2199e26b5e95f5d45db39dcd4e3b459eb5f1c47e65494dc2ad1f0"}
Jul 09 18:12:49.928648 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:49.928614    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"]
Jul 09 18:12:49.936613 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:49.936593    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:49.939493 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:49.939474    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nx2xg\""
Jul 09 18:12:49.945877 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:49.945853    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"]
Jul 09 18:12:50.044988 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:50.044956    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d85a840-b46c-4c6f-a363-79c65aee2797-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-nws8x\" (UID: \"9d85a840-b46c-4c6f-a363-79c65aee2797\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:50.044988 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:50.044999    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbzh\" (UniqueName: \"kubernetes.io/projected/9d85a840-b46c-4c6f-a363-79c65aee2797-kube-api-access-lfbzh\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-nws8x\" (UID: \"9d85a840-b46c-4c6f-a363-79c65aee2797\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:50.145948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:50.145912    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d85a840-b46c-4c6f-a363-79c65aee2797-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-nws8x\" (UID: \"9d85a840-b46c-4c6f-a363-79c65aee2797\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:50.146140 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:50.145957    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbzh\" (UniqueName: \"kubernetes.io/projected/9d85a840-b46c-4c6f-a363-79c65aee2797-kube-api-access-lfbzh\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-nws8x\" (UID: \"9d85a840-b46c-4c6f-a363-79c65aee2797\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:50.146382 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:50.146359    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d85a840-b46c-4c6f-a363-79c65aee2797-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-nws8x\" (UID: \"9d85a840-b46c-4c6f-a363-79c65aee2797\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:50.155071 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:50.155025    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbzh\" (UniqueName: \"kubernetes.io/projected/9d85a840-b46c-4c6f-a363-79c65aee2797-kube-api-access-lfbzh\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-nws8x\" (UID: \"9d85a840-b46c-4c6f-a363-79c65aee2797\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:50.248535 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:50.248448    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:50.403224 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:50.403197    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"]
Jul 09 18:12:50.404778 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:12:50.404749    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d85a840_b46c_4c6f_a363_79c65aee2797.slice/crio-9d46c2e1f449982102e64af32e9e028c1dd285febc2eab41ab60ac6d87234da6 WatchSource:0}: Error finding container 9d46c2e1f449982102e64af32e9e028c1dd285febc2eab41ab60ac6d87234da6: Status 404 returned error can't find the container with id 9d46c2e1f449982102e64af32e9e028c1dd285febc2eab41ab60ac6d87234da6
Jul 09 18:12:51.413823 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:51.413782    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x" event={"ID":"9d85a840-b46c-4c6f-a363-79c65aee2797","Type":"ContainerStarted","Data":"9d46c2e1f449982102e64af32e9e028c1dd285febc2eab41ab60ac6d87234da6"}
Jul 09 18:12:55.377382 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:55.377343    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d85f6564-586ks"
Jul 09 18:12:59.459785 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:59.459749    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x" event={"ID":"9d85a840-b46c-4c6f-a363-79c65aee2797","Type":"ContainerStarted","Data":"eb2f6b43ed1cf3201822ee0fa50e947cecbb9d1347a2212f61365f2bea58cfd3"}
Jul 09 18:12:59.460175 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:59.459813    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:12:59.488727 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:12:59.488681    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x" podStartSLOduration=1.558869311 podStartE2EDuration="10.488661601s" totalImagesPullingTime="8.92979229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:59.486803649 +0000 UTC m=+500.985860400" watchObservedRunningTime="2026-07-09 18:12:59.488661601 +0000 UTC m=+500.987718347"
Jul 09 18:13:10.467038 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:10.467009    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-nws8x"
Jul 09 18:13:13.535776 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:13.535739    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl" event={"ID":"02100c7b-b225-4c38-9549-e00493058a7a","Type":"ContainerStarted","Data":"38fc7ffa51d8fe987338be1364ad0c6d6d93b9ae878bc138fbbf34138a4c575e"}
Jul 09 18:13:13.536199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:13.535925    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"
Jul 09 18:13:13.561028 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:13.560982    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl" podStartSLOduration=1.84924077 podStartE2EDuration="28.56096793s" totalImagesPullingTime="26.71172716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:13:13.559272048 +0000 UTC m=+515.058328797" watchObservedRunningTime="2026-07-09 18:13:13.56096793 +0000 UTC m=+515.060024677"
Jul 09 18:13:24.544470 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:24.544434    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-vckrl"
Jul 09 18:13:42.753178 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:42.753093    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-prlh5"]
Jul 09 18:13:42.757613 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:42.757593    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:42.762308 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:42.762281    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dxql7\""
Jul 09 18:13:42.762466 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:42.762287    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 18:13:42.778144 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:42.778110    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-prlh5"]
Jul 09 18:13:42.822786 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:42.822748    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-prlh5"]
Jul 09 18:13:42.900347 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:42.900307    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9q6v\" (UniqueName: \"kubernetes.io/projected/7f7f995d-90bb-4baf-a7d7-ecc20d8297d8-kube-api-access-z9q6v\") pod \"limitador-limitador-69574b596d-prlh5\" (UID: \"7f7f995d-90bb-4baf-a7d7-ecc20d8297d8\") " pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:42.900347 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:42.900349    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7f7f995d-90bb-4baf-a7d7-ecc20d8297d8-config-file\") pod \"limitador-limitador-69574b596d-prlh5\" (UID: \"7f7f995d-90bb-4baf-a7d7-ecc20d8297d8\") " pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:43.001685 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:43.001639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9q6v\" (UniqueName: \"kubernetes.io/projected/7f7f995d-90bb-4baf-a7d7-ecc20d8297d8-kube-api-access-z9q6v\") pod \"limitador-limitador-69574b596d-prlh5\" (UID: \"7f7f995d-90bb-4baf-a7d7-ecc20d8297d8\") " pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:43.001685 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:43.001692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7f7f995d-90bb-4baf-a7d7-ecc20d8297d8-config-file\") pod \"limitador-limitador-69574b596d-prlh5\" (UID: \"7f7f995d-90bb-4baf-a7d7-ecc20d8297d8\") " pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:43.002412 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:43.002391    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7f7f995d-90bb-4baf-a7d7-ecc20d8297d8-config-file\") pod \"limitador-limitador-69574b596d-prlh5\" (UID: \"7f7f995d-90bb-4baf-a7d7-ecc20d8297d8\") " pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:43.013506 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:43.013432    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9q6v\" (UniqueName: \"kubernetes.io/projected/7f7f995d-90bb-4baf-a7d7-ecc20d8297d8-kube-api-access-z9q6v\") pod \"limitador-limitador-69574b596d-prlh5\" (UID: \"7f7f995d-90bb-4baf-a7d7-ecc20d8297d8\") " pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:43.069256 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:43.069225    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:43.247492 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:43.247461    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-prlh5"]
Jul 09 18:13:43.250372 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:13:43.250336    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7f995d_90bb_4baf_a7d7_ecc20d8297d8.slice/crio-6d4e28648053a1119e9fa4a2e03f321058edff426f6568e51b1933a833d38816 WatchSource:0}: Error finding container 6d4e28648053a1119e9fa4a2e03f321058edff426f6568e51b1933a833d38816: Status 404 returned error can't find the container with id 6d4e28648053a1119e9fa4a2e03f321058edff426f6568e51b1933a833d38816
Jul 09 18:13:43.699955 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:43.699873    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-prlh5" event={"ID":"7f7f995d-90bb-4baf-a7d7-ecc20d8297d8","Type":"ContainerStarted","Data":"6d4e28648053a1119e9fa4a2e03f321058edff426f6568e51b1933a833d38816"}
Jul 09 18:13:47.725290 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:47.725248    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-prlh5" event={"ID":"7f7f995d-90bb-4baf-a7d7-ecc20d8297d8","Type":"ContainerStarted","Data":"d3219c67e03379aadceba2f6de931f90670eb6f52787fb9a481c18ee5ef70a8b"}
Jul 09 18:13:47.725762 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:47.725329    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:13:47.746401 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:47.746291    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-69574b596d-prlh5" podStartSLOduration=2.274454346 podStartE2EDuration="5.746270069s" totalImagesPullingTime="3.471815723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:13:47.746211172 +0000 UTC m=+549.245267920" watchObservedRunningTime="2026-07-09 18:13:47.746270069 +0000 UTC m=+549.245326816"
Jul 09 18:13:58.732114 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:13:58.732050    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-69574b596d-prlh5"
Jul 09 18:14:16.172543 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.172507    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-7zbdq"]
Jul 09 18:14:16.172961 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.172700    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq" podUID="2d9d0703-6626-4f35-bbf6-76bef79ba397" containerName="manager" containerID="cri-o://a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f" gracePeriod=10
Jul 09 18:14:16.230950 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.230924    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-jffg6"]
Jul 09 18:14:16.233340 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.233325    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:16.251891 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.251869    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-jffg6"]
Jul 09 18:14:16.294128 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.294098    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4236e806-ccef-486f-ae02-6f5802ff20d0-cert\") pod \"kserve-controller-manager-57b57d8c6-jffg6\" (UID: \"4236e806-ccef-486f-ae02-6f5802ff20d0\") " pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:16.294241 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.294144    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtkzz\" (UniqueName: \"kubernetes.io/projected/4236e806-ccef-486f-ae02-6f5802ff20d0-kube-api-access-rtkzz\") pod \"kserve-controller-manager-57b57d8c6-jffg6\" (UID: \"4236e806-ccef-486f-ae02-6f5802ff20d0\") " pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:16.395384 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.395352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4236e806-ccef-486f-ae02-6f5802ff20d0-cert\") pod \"kserve-controller-manager-57b57d8c6-jffg6\" (UID: \"4236e806-ccef-486f-ae02-6f5802ff20d0\") " pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:16.395564 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.395393    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtkzz\" (UniqueName: \"kubernetes.io/projected/4236e806-ccef-486f-ae02-6f5802ff20d0-kube-api-access-rtkzz\") pod \"kserve-controller-manager-57b57d8c6-jffg6\" (UID: \"4236e806-ccef-486f-ae02-6f5802ff20d0\") " pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:16.397909 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.397874    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4236e806-ccef-486f-ae02-6f5802ff20d0-cert\") pod \"kserve-controller-manager-57b57d8c6-jffg6\" (UID: \"4236e806-ccef-486f-ae02-6f5802ff20d0\") " pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:16.409665 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.409640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtkzz\" (UniqueName: \"kubernetes.io/projected/4236e806-ccef-486f-ae02-6f5802ff20d0-kube-api-access-rtkzz\") pod \"kserve-controller-manager-57b57d8c6-jffg6\" (UID: \"4236e806-ccef-486f-ae02-6f5802ff20d0\") " pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:16.429619 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.429558    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:14:16.495985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.495956    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhh4h\" (UniqueName: \"kubernetes.io/projected/2d9d0703-6626-4f35-bbf6-76bef79ba397-kube-api-access-qhh4h\") pod \"2d9d0703-6626-4f35-bbf6-76bef79ba397\" (UID: \"2d9d0703-6626-4f35-bbf6-76bef79ba397\") "
Jul 09 18:14:16.496195 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.496022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d9d0703-6626-4f35-bbf6-76bef79ba397-cert\") pod \"2d9d0703-6626-4f35-bbf6-76bef79ba397\" (UID: \"2d9d0703-6626-4f35-bbf6-76bef79ba397\") "
Jul 09 18:14:16.497985 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.497959    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d9d0703-6626-4f35-bbf6-76bef79ba397-kube-api-access-qhh4h" (OuterVolumeSpecName: "kube-api-access-qhh4h") pod "2d9d0703-6626-4f35-bbf6-76bef79ba397" (UID: "2d9d0703-6626-4f35-bbf6-76bef79ba397"). InnerVolumeSpecName "kube-api-access-qhh4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:14:16.498121 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.498036    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d9d0703-6626-4f35-bbf6-76bef79ba397-cert" (OuterVolumeSpecName: "cert") pod "2d9d0703-6626-4f35-bbf6-76bef79ba397" (UID: "2d9d0703-6626-4f35-bbf6-76bef79ba397"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:14:16.554358 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.554330    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:16.597509 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.597476    2569 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d9d0703-6626-4f35-bbf6-76bef79ba397-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:14:16.597509 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.597503    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhh4h\" (UniqueName: \"kubernetes.io/projected/2d9d0703-6626-4f35-bbf6-76bef79ba397-kube-api-access-qhh4h\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:14:16.680580 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.680551    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-jffg6"]
Jul 09 18:14:16.682253 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:14:16.682229    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4236e806_ccef_486f_ae02_6f5802ff20d0.slice/crio-5fbdb602e1762aa88b51215a559328531b9ddb5fda2ee8c51b89e17e00bf9eb9 WatchSource:0}: Error finding container 5fbdb602e1762aa88b51215a559328531b9ddb5fda2ee8c51b89e17e00bf9eb9: Status 404 returned error can't find the container with id 5fbdb602e1762aa88b51215a559328531b9ddb5fda2ee8c51b89e17e00bf9eb9
Jul 09 18:14:16.891703 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.891671    2569 generic.go:356] "Generic (PLEG): container finished" podID="2d9d0703-6626-4f35-bbf6-76bef79ba397" containerID="a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f" exitCode=0
Jul 09 18:14:16.891876 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.891717    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq"
Jul 09 18:14:16.891876 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.891759    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq" event={"ID":"2d9d0703-6626-4f35-bbf6-76bef79ba397","Type":"ContainerDied","Data":"a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f"}
Jul 09 18:14:16.891876 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.891823    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57b57d8c6-7zbdq" event={"ID":"2d9d0703-6626-4f35-bbf6-76bef79ba397","Type":"ContainerDied","Data":"06193c79dde0d28e7eb2e3936c6f59aedc2dc9f3fbc6edf349b1ae2d220772a4"}
Jul 09 18:14:16.891876 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.891856    2569 scope.go:117] "RemoveContainer" containerID="a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f"
Jul 09 18:14:16.893019 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.892995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57b57d8c6-jffg6" event={"ID":"4236e806-ccef-486f-ae02-6f5802ff20d0","Type":"ContainerStarted","Data":"5fbdb602e1762aa88b51215a559328531b9ddb5fda2ee8c51b89e17e00bf9eb9"}
Jul 09 18:14:16.900786 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.900770    2569 scope.go:117] "RemoveContainer" containerID="a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f"
Jul 09 18:14:16.901034 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:14:16.901015    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f\": container with ID starting with a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f not found: ID does not exist" containerID="a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f"
Jul 09 18:14:16.901147 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.901045    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f"} err="failed to get container status \"a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f\": rpc error: code = NotFound desc = could not find container \"a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f\": container with ID starting with a476b75b6783c8f21ebd153229b9c84851d03a42278f648e4997940541694d5f not found: ID does not exist"
Jul 09 18:14:16.918986 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.918949    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-7zbdq"]
Jul 09 18:14:16.921503 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:16.921481    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-57b57d8c6-7zbdq"]
Jul 09 18:14:17.122225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:17.122189    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d9d0703-6626-4f35-bbf6-76bef79ba397" path="/var/lib/kubelet/pods/2d9d0703-6626-4f35-bbf6-76bef79ba397/volumes"
Jul 09 18:14:17.901111 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:17.901069    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57b57d8c6-jffg6" event={"ID":"4236e806-ccef-486f-ae02-6f5802ff20d0","Type":"ContainerStarted","Data":"439a74bbd4308ed9a6cf06913f4b65feea1b14d390dd910f2493912c69fb081d"}
Jul 09 18:14:17.901586 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:17.901136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:14:17.933566 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:17.933521    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-57b57d8c6-jffg6" podStartSLOduration=1.366828626 podStartE2EDuration="1.933504617s" totalImagesPullingTime="566.675991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:14:17.931318783 +0000 UTC m=+579.430375531" watchObservedRunningTime="2026-07-09 18:14:17.933504617 +0000 UTC m=+579.432561363"
Jul 09 18:14:38.977209 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:38.977181    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:14:38.977684 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:38.977181    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:14:48.911459 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:14:48.911422    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-57b57d8c6-jffg6"
Jul 09 18:16:38.868275 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.868243    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"]
Jul 09 18:16:38.868665 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.868649    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9d0703-6626-4f35-bbf6-76bef79ba397" containerName="manager"
Jul 09 18:16:38.868665 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.868660    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9d0703-6626-4f35-bbf6-76bef79ba397" containerName="manager"
Jul 09 18:16:38.868735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.868713    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d9d0703-6626-4f35-bbf6-76bef79ba397" containerName="manager"
Jul 09 18:16:38.871018 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.870997    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.873753 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.873726    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:16:38.873916 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.873896    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-7sv49\""
Jul 09 18:16:38.873994 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.873929    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:16:38.874183 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.874167    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:16:38.884376 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.884353    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"]
Jul 09 18:16:38.895155 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.895268 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.895329 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895268    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.895329 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.895490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.895490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.895490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4tm5\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-kube-api-access-d4tm5\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.895490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895483    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.895704 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.895512    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996007 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.995934    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996007 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.995981    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996014    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996033    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996097    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tm5\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-kube-api-access-d4tm5\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996147    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996173    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996201    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996542 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996234    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996542 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996379    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996542 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996448    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996676 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996609    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.996676 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.996640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.998564 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.998543    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.998747 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.998725    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:38.998800 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:38.998747    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:16:39.004841 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.004818    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:39.005205 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.005186    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:16:39.007148 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.007116    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:39.020867 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.020840    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:16:39.030477 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.030455    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4tm5\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-kube-api-access-d4tm5\") pod \"router-gateway-1-openshift-default-54c47cdfc7-pzm88\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:39.184532 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.184506    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-7sv49\""
Jul 09 18:16:39.192355 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.192331    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:39.333899 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.333873    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"]
Jul 09 18:16:39.335524 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:16:39.335502    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90a95ad_e1b7_41f4_a901_4fd31bd649ba.slice/crio-94e43fc6470ac61dd686036ba7c42b4d4fd23fe321331123688fa067172a81d5 WatchSource:0}: Error finding container 94e43fc6470ac61dd686036ba7c42b4d4fd23fe321331123688fa067172a81d5: Status 404 returned error can't find the container with id 94e43fc6470ac61dd686036ba7c42b4d4fd23fe321331123688fa067172a81d5
Jul 09 18:16:39.337563 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.337528    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:16:39.337657 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.337601    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:16:39.337657 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.337627    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:16:39.645889 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.645854    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" event={"ID":"a90a95ad-e1b7-41f4-a901-4fd31bd649ba","Type":"ContainerStarted","Data":"c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc"}
Jul 09 18:16:39.646076 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.645914    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" event={"ID":"a90a95ad-e1b7-41f4-a901-4fd31bd649ba","Type":"ContainerStarted","Data":"94e43fc6470ac61dd686036ba7c42b4d4fd23fe321331123688fa067172a81d5"}
Jul 09 18:16:39.675276 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:39.675233    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" podStartSLOduration=1.675217177 podStartE2EDuration="1.675217177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:16:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:16:39.674008347 +0000 UTC m=+721.173065093" watchObservedRunningTime="2026-07-09 18:16:39.675217177 +0000 UTC m=+721.174273923"
Jul 09 18:16:40.192733 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:40.192704    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:40.197575 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:40.197552    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:40.651587 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:40.651557    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:40.652558 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:40.652540    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:53.724244 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:53.724214    2569 generic.go:356] "Generic (PLEG): container finished" podID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerID="c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc" exitCode=0
Jul 09 18:16:53.724565 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:53.724272    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" event={"ID":"a90a95ad-e1b7-41f4-a901-4fd31bd649ba","Type":"ContainerDied","Data":"c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc"}
Jul 09 18:16:53.724691 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:53.724673    2569 scope.go:117] "RemoveContainer" containerID="c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc"
Jul 09 18:16:53.725728 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:53.725700    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:16:53.725787 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:53.725767    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:16:53.725830 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:53.725802    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:16:54.735625 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:54.735590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" event={"ID":"a90a95ad-e1b7-41f4-a901-4fd31bd649ba","Type":"ContainerStarted","Data":"1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a"}
Jul 09 18:16:55.193170 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:55.193137    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:55.194227 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:55.194194    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 09 18:16:55.652049 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:55.652018    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:16:56.193123 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:56.193090    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 09 18:16:57.193696 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:57.193657    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 09 18:16:58.193790 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:58.193744    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 09 18:16:59.192851 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:16:59.192802    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 09 18:17:00.196168 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:00.196140    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:17:00.197167 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:00.197136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:17:04.895824 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:04.895791    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"]
Jul 09 18:17:04.896274 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:04.896000    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy" containerID="cri-o://1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a" gracePeriod=30
Jul 09 18:17:10.148877 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.148853    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:17:10.301796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.301723    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istiod-ca-cert\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.301796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.301764    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-podinfo\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.301796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.301784    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-credential-socket\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.301801    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4tm5\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-kube-api-access-d4tm5\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.301832    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-envoy\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.301971    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-socket\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302031    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-token\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302088    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-certs\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302117    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-data\") pod \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\" (UID: \"a90a95ad-e1b7-41f4-a901-4fd31bd649ba\") "
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302168    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302175    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302252    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:17:10.302457 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302340    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:17:10.302995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302476    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:17:10.302995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302551    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-credential-socket\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.302995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302572    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-socket\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.302995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302585    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-workload-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.302995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302597    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-data\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.302995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.302609    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istiod-ca-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.304284 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.304251    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:17:10.304284 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.304258    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-kube-api-access-d4tm5" (OuterVolumeSpecName: "kube-api-access-d4tm5") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "kube-api-access-d4tm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:17:10.304410 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.304322    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:17:10.304410 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.304391    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a90a95ad-e1b7-41f4-a901-4fd31bd649ba" (UID: "a90a95ad-e1b7-41f4-a901-4fd31bd649ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:17:10.403220 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.403195    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-podinfo\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.403220 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.403217    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4tm5\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-kube-api-access-d4tm5\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.403373 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.403227    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-envoy\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.403373 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.403235    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90a95ad-e1b7-41f4-a901-4fd31bd649ba-istio-token\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:17:10.829482 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.829450    2569 generic.go:356] "Generic (PLEG): container finished" podID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerID="1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a" exitCode=0
Jul 09 18:17:10.829662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.829501    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"
Jul 09 18:17:10.829662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.829534    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" event={"ID":"a90a95ad-e1b7-41f4-a901-4fd31bd649ba","Type":"ContainerDied","Data":"1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a"}
Jul 09 18:17:10.829662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.829594    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88" event={"ID":"a90a95ad-e1b7-41f4-a901-4fd31bd649ba","Type":"ContainerDied","Data":"94e43fc6470ac61dd686036ba7c42b4d4fd23fe321331123688fa067172a81d5"}
Jul 09 18:17:10.829662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.829629    2569 scope.go:117] "RemoveContainer" containerID="1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a"
Jul 09 18:17:10.839464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.839444    2569 scope.go:117] "RemoveContainer" containerID="c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc"
Jul 09 18:17:10.847672 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.847653    2569 scope.go:117] "RemoveContainer" containerID="1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a"
Jul 09 18:17:10.847929 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:17:10.847909    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a\": container with ID starting with 1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a not found: ID does not exist" containerID="1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a"
Jul 09 18:17:10.847995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.847937    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a"} err="failed to get container status \"1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a\": rpc error: code = NotFound desc = could not find container \"1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a\": container with ID starting with 1f225da53515a54220002c5d7810f675035bf4ba34e0568f6ed4d26879a5786a not found: ID does not exist"
Jul 09 18:17:10.847995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.847954    2569 scope.go:117] "RemoveContainer" containerID="c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc"
Jul 09 18:17:10.848202 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:17:10.848187    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc\": container with ID starting with c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc not found: ID does not exist" containerID="c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc"
Jul 09 18:17:10.848253 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.848207    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc"} err="failed to get container status \"c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc\": rpc error: code = NotFound desc = could not find container \"c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc\": container with ID starting with c21c4abba42d24074265d8b19e6854134189d5e56bab71e7e3afb915319533bc not found: ID does not exist"
Jul 09 18:17:10.853022 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.853002    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"]
Jul 09 18:17:10.858570 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:10.858546    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-pzm88"]
Jul 09 18:17:11.122789 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:11.122713    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" path="/var/lib/kubelet/pods/a90a95ad-e1b7-41f4-a901-4fd31bd649ba/volumes"
Jul 09 18:17:21.666619 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.666589    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"]
Jul 09 18:17:21.667233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.667169    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy"
Jul 09 18:17:21.667233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.667189    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy"
Jul 09 18:17:21.667233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.667214    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy"
Jul 09 18:17:21.667233 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.667222    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy"
Jul 09 18:17:21.667390 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.667307    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy"
Jul 09 18:17:21.670525 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.670509    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.674667 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.674647    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 09 18:17:21.674774 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.674650    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:17:21.674774 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.674648    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:17:21.674774 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.674657    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-s8z92\""
Jul 09 18:17:21.679290 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.679270    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"]
Jul 09 18:17:21.694437 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.694405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.694582 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.694465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j49b\" (UniqueName: \"kubernetes.io/projected/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-kube-api-access-6j49b\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.694582 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.694550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.694678 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.694634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.694735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.694674    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.694735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.694718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.795903 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.795874    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.796113 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.795928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.796113 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.795954    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.796113 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.795973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.796113 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.796011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.796113 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.796045    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j49b\" (UniqueName: \"kubernetes.io/projected/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-kube-api-access-6j49b\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.796464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.796365    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.796675 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.796631    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.796793 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.796699    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.798773 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.798745    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.798866 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.798793    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.804694 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.804665    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j49b\" (UniqueName: \"kubernetes.io/projected/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-kube-api-access-6j49b\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:21.982388 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:21.982315    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:22.124835 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:22.124804    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"]
Jul 09 18:17:22.125982 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:17:22.125950    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6926e4f2_c6b9_4099_b77a_8b11eeb56f2f.slice/crio-aff1627bb9115e5c9fc6e67050546d0f71efb3c0cd684415fb6d56e3362f6c62 WatchSource:0}: Error finding container aff1627bb9115e5c9fc6e67050546d0f71efb3c0cd684415fb6d56e3362f6c62: Status 404 returned error can't find the container with id aff1627bb9115e5c9fc6e67050546d0f71efb3c0cd684415fb6d56e3362f6c62
Jul 09 18:17:22.128553 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:22.128535    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:17:22.901815 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:22.901770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz" event={"ID":"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f","Type":"ContainerStarted","Data":"aff1627bb9115e5c9fc6e67050546d0f71efb3c0cd684415fb6d56e3362f6c62"}
Jul 09 18:17:23.379743 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.379710    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:38558->10.133.0.34:15021: read: connection reset by peer" start-of-body=
Jul 09 18:17:23.379918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.379777    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:38558->10.133.0.34:15021: read: connection reset by peer"
Jul 09 18:17:23.909662 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.909629    2569 generic.go:356] "Generic (PLEG): container finished" podID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerID="6300db07e80393885932896eb21052bf6256e9a5405b6a34f4f50bb1d1832acd" exitCode=0
Jul 09 18:17:23.910159 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.909706    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" event={"ID":"fb8342bd-81ef-451a-81a1-8f8fe26e6108","Type":"ContainerDied","Data":"6300db07e80393885932896eb21052bf6256e9a5405b6a34f4f50bb1d1832acd"}
Jul 09 18:17:23.910253 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.910196    2569 scope.go:117] "RemoveContainer" containerID="6300db07e80393885932896eb21052bf6256e9a5405b6a34f4f50bb1d1832acd"
Jul 09 18:17:23.911376 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.911336    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:17:23.911499 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.911430    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:17:23.911499 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.911476    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:17:23.911614 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.911585    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz" event={"ID":"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f","Type":"ContainerStarted","Data":"540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb"}
Jul 09 18:17:23.952871 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.952711    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz" podStartSLOduration=1.74610375 podStartE2EDuration="2.952692117s" totalImagesPullingTime="1.206588367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:17:23.949479087 +0000 UTC m=+765.448535835" watchObservedRunningTime="2026-07-09 18:17:23.952692117 +0000 UTC m=+765.451748865"
Jul 09 18:17:23.982705 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:23.982683    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:24.922695 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:24.922653    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" event={"ID":"fb8342bd-81ef-451a-81a1-8f8fe26e6108","Type":"ContainerStarted","Data":"f5f62688e48c2bed7ed6948a5baeb1652e27722f480c6c7b8ec9d8c1e4b1d7c8"}
Jul 09 18:17:25.056648 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:25.056611    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:17:25.056873 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:25.056851    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:17:25.056956 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:25.056905    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:17:26.057426 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:26.057393    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:17:26.057809 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:26.057440    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:17:27.057390 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:27.057355    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:17:27.057570 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:27.057410    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:17:28.056900 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:28.056861    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:17:28.057093 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:28.056940    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:17:29.057394 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:29.057361    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:17:29.057787 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:29.057425    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:17:30.056713 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:30.056679    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:17:30.056885 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:30.056747    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:17:31.059949 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:31.059918    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:17:31.060420 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:31.060367    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:17:31.060946 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:31.060929    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:17:31.983448 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:31.983411    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:31.995786 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:31.995761    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:32.989540 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:32.989506    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:17:49.280290 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:17:49.280257    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"]
Jul 09 18:18:04.301172 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.301042    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz" podUID="6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" containerName="main" containerID="cri-o://540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb" gracePeriod=45
Jul 09 18:18:04.550926 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.550901    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:18:04.679616 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.679581    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-dshm\") pod \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") "
Jul 09 18:18:04.679794 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.679632    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tls-certs\") pod \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") "
Jul 09 18:18:04.679794 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.679654    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-home\") pod \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") "
Jul 09 18:18:04.679794 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.679771    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tmp-dir\") pod \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") "
Jul 09 18:18:04.679931 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.679853    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j49b\" (UniqueName: \"kubernetes.io/projected/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-kube-api-access-6j49b\") pod \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") "
Jul 09 18:18:04.679931 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.679892    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-model-cache\") pod \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\" (UID: \"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f\") "
Jul 09 18:18:04.679931 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.679904    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-home" (OuterVolumeSpecName: "home") pod "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" (UID: "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:18:04.680102 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.679999    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" (UID: "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:18:04.680241 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.680212    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tmp-dir\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:18:04.680241 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.680240    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-home\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:18:04.680397 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.680218    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-model-cache" (OuterVolumeSpecName: "model-cache") pod "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" (UID: "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:18:04.681887 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.681858    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-dshm" (OuterVolumeSpecName: "dshm") pod "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" (UID: "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:18:04.682207 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.682181    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" (UID: "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:18:04.682296 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.682210    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-kube-api-access-6j49b" (OuterVolumeSpecName: "kube-api-access-6j49b") pod "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" (UID: "6926e4f2-c6b9-4099-b77a-8b11eeb56f2f"). InnerVolumeSpecName "kube-api-access-6j49b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:18:04.781000 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.780969    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j49b\" (UniqueName: \"kubernetes.io/projected/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-kube-api-access-6j49b\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:18:04.781000 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.780994    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-model-cache\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:18:04.781000 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.781003    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-dshm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:18:04.781000 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:04.781011    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:18:05.156713 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.156677    2569 generic.go:356] "Generic (PLEG): container finished" podID="6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" containerID="540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb" exitCode=0
Jul 09 18:18:05.156864 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.156728    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"
Jul 09 18:18:05.156864 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.156758    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz" event={"ID":"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f","Type":"ContainerDied","Data":"540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb"}
Jul 09 18:18:05.156864 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.156813    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz" event={"ID":"6926e4f2-c6b9-4099-b77a-8b11eeb56f2f","Type":"ContainerDied","Data":"aff1627bb9115e5c9fc6e67050546d0f71efb3c0cd684415fb6d56e3362f6c62"}
Jul 09 18:18:05.156864 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.156837    2569 scope.go:117] "RemoveContainer" containerID="540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb"
Jul 09 18:18:05.165511 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.165493    2569 scope.go:117] "RemoveContainer" containerID="540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb"
Jul 09 18:18:05.165753 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:18:05.165736    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb\": container with ID starting with 540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb not found: ID does not exist" containerID="540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb"
Jul 09 18:18:05.165833 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.165764    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb"} err="failed to get container status \"540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb\": rpc error: code = NotFound desc = could not find container \"540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb\": container with ID starting with 540e139819e827b82363596f6c165c863514221f61e9ad7c3b0791ddfc7f8edb not found: ID does not exist"
Jul 09 18:18:05.190012 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.189986    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"]
Jul 09 18:18:05.194488 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:05.194469    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bgnztz"]
Jul 09 18:18:07.121857 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:18:07.121828    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" path="/var/lib/kubelet/pods/6926e4f2-c6b9-4099-b77a-8b11eeb56f2f/volumes"
Jul 09 18:19:39.012978 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:19:39.012951    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:19:39.014447 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:19:39.014419    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:21:27.686120 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.686024    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"]
Jul 09 18:21:27.686651 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.686460    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" containerName="main"
Jul 09 18:21:27.686651 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.686472    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" containerName="main"
Jul 09 18:21:27.686651 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.686587    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6926e4f2-c6b9-4099-b77a-8b11eeb56f2f" containerName="main"
Jul 09 18:21:27.686651 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.686601    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90a95ad-e1b7-41f4-a901-4fd31bd649ba" containerName="istio-proxy"
Jul 09 18:21:27.689010 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.688989    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.691955 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.691931    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:21:27.693252 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.693225    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:21:27.693369 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.693225    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Jul 09 18:21:27.693542 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.693519    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-z7tkx\""
Jul 09 18:21:27.693806 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.693785    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-s8z92\""
Jul 09 18:21:27.704845 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.704823    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"]
Jul 09 18:21:27.865011 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.864978    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4f9k\" (UniqueName: \"kubernetes.io/projected/240adbd5-f80a-4d42-a4d3-befcc024a482-kube-api-access-d4f9k\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.865198 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.865030    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/240adbd5-f80a-4d42-a4d3-befcc024a482-tokenizer-uds\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.865198 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.865088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240adbd5-f80a-4d42-a4d3-befcc024a482-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.965992 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.965901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/240adbd5-f80a-4d42-a4d3-befcc024a482-tokenizer-uds\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.965992 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.965947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240adbd5-f80a-4d42-a4d3-befcc024a482-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.966229 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.966021    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4f9k\" (UniqueName: \"kubernetes.io/projected/240adbd5-f80a-4d42-a4d3-befcc024a482-kube-api-access-d4f9k\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.966376 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.966351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/240adbd5-f80a-4d42-a4d3-befcc024a482-tokenizer-uds\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.968420 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.968392    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240adbd5-f80a-4d42-a4d3-befcc024a482-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:27.975448 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:27.975425    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4f9k\" (UniqueName: \"kubernetes.io/projected/240adbd5-f80a-4d42-a4d3-befcc024a482-kube-api-access-d4f9k\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") " pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:28.000282 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:28.000265    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:28.136956 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:28.136925    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"]
Jul 09 18:21:28.137294 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:21:28.137255    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240adbd5_f80a_4d42_a4d3_befcc024a482.slice/crio-210dd236962f7845573ce027faa0de4967cf9731c5824f24a080aae85bf2b78d WatchSource:0}: Error finding container 210dd236962f7845573ce027faa0de4967cf9731c5824f24a080aae85bf2b78d: Status 404 returned error can't find the container with id 210dd236962f7845573ce027faa0de4967cf9731c5824f24a080aae85bf2b78d
Jul 09 18:21:28.284614 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:28.284533    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g" event={"ID":"240adbd5-f80a-4d42-a4d3-befcc024a482","Type":"ContainerStarted","Data":"210dd236962f7845573ce027faa0de4967cf9731c5824f24a080aae85bf2b78d"}
Jul 09 18:21:30.302788 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:30.302754    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g" event={"ID":"240adbd5-f80a-4d42-a4d3-befcc024a482","Type":"ContainerStarted","Data":"6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd"}
Jul 09 18:21:30.303298 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:30.302870    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:21:30.334404 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:21:30.334357    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g" podStartSLOduration=2.220083226 podStartE2EDuration="3.334340608s" totalImagesPullingTime="1.114257382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:21:30.33413217 +0000 UTC m=+1011.833188918" watchObservedRunningTime="2026-07-09 18:21:30.334340608 +0000 UTC m=+1011.833397354"
Jul 09 18:22:01.310464 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:01.310436    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:22:17.047206 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.047171    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"]
Jul 09 18:22:17.056199 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:22:17.056164    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:22:17.056199 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:22:17.056199 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:22:17.056199 ip-10-0-131-205 kubenswrapper[2569]:  > containerID="6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd" cmd=["/bin/sleep","15"]
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.056216    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g" message="" err=<
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]:  >
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:22:17.056228    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g" podUID="240adbd5-f80a-4d42-a4d3-befcc024a482" containerName="main" containerID="cri-o://6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd"
Jul 09 18:22:17.056490 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.056273    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g" podUID="240adbd5-f80a-4d42-a4d3-befcc024a482" containerName="main" containerID="cri-o://6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd" gracePeriod=60
Jul 09 18:22:17.297024 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.297001    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:22:17.405508 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.405474    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240adbd5-f80a-4d42-a4d3-befcc024a482-tls-certs\") pod \"240adbd5-f80a-4d42-a4d3-befcc024a482\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") "
Jul 09 18:22:17.405508 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.405516    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4f9k\" (UniqueName: \"kubernetes.io/projected/240adbd5-f80a-4d42-a4d3-befcc024a482-kube-api-access-d4f9k\") pod \"240adbd5-f80a-4d42-a4d3-befcc024a482\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") "
Jul 09 18:22:17.405808 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.405585    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/240adbd5-f80a-4d42-a4d3-befcc024a482-tokenizer-uds\") pod \"240adbd5-f80a-4d42-a4d3-befcc024a482\" (UID: \"240adbd5-f80a-4d42-a4d3-befcc024a482\") "
Jul 09 18:22:17.406014 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.405989    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240adbd5-f80a-4d42-a4d3-befcc024a482-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "240adbd5-f80a-4d42-a4d3-befcc024a482" (UID: "240adbd5-f80a-4d42-a4d3-befcc024a482"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:22:17.407638 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.407614    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240adbd5-f80a-4d42-a4d3-befcc024a482-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "240adbd5-f80a-4d42-a4d3-befcc024a482" (UID: "240adbd5-f80a-4d42-a4d3-befcc024a482"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:22:17.408013 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.407995    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240adbd5-f80a-4d42-a4d3-befcc024a482-kube-api-access-d4f9k" (OuterVolumeSpecName: "kube-api-access-d4f9k") pod "240adbd5-f80a-4d42-a4d3-befcc024a482" (UID: "240adbd5-f80a-4d42-a4d3-befcc024a482"). InnerVolumeSpecName "kube-api-access-d4f9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:22:17.507039 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.506991    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240adbd5-f80a-4d42-a4d3-befcc024a482-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:22:17.507039 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.507025    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4f9k\" (UniqueName: \"kubernetes.io/projected/240adbd5-f80a-4d42-a4d3-befcc024a482-kube-api-access-d4f9k\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:22:17.507039 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.507041    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/240adbd5-f80a-4d42-a4d3-befcc024a482-tokenizer-uds\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:22:17.557255 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.557227    2569 generic.go:356] "Generic (PLEG): container finished" podID="240adbd5-f80a-4d42-a4d3-befcc024a482" containerID="6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd" exitCode=0
Jul 09 18:22:17.557431 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.557275    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"
Jul 09 18:22:17.557431 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.557328    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g" event={"ID":"240adbd5-f80a-4d42-a4d3-befcc024a482","Type":"ContainerDied","Data":"6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd"}
Jul 09 18:22:17.557431 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.557382    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g" event={"ID":"240adbd5-f80a-4d42-a4d3-befcc024a482","Type":"ContainerDied","Data":"210dd236962f7845573ce027faa0de4967cf9731c5824f24a080aae85bf2b78d"}
Jul 09 18:22:17.557431 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.557409    2569 scope.go:117] "RemoveContainer" containerID="6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd"
Jul 09 18:22:17.567174 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.567148    2569 scope.go:117] "RemoveContainer" containerID="6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd"
Jul 09 18:22:17.567464 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:22:17.567440    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd\": container with ID starting with 6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd not found: ID does not exist" containerID="6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd"
Jul 09 18:22:17.567578 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.567474    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd"} err="failed to get container status \"6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd\": rpc error: code = NotFound desc = could not find container \"6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd\": container with ID starting with 6d995cf3679aed83483eaef472f45afe253f15b2e7b660dca8f6c8875ebcf6fd not found: ID does not exist"
Jul 09 18:22:17.588569 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.588548    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"]
Jul 09 18:22:17.592735 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:17.592715    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheqjx2g"]
Jul 09 18:22:19.122935 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:22:19.122894    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240adbd5-f80a-4d42-a4d3-befcc024a482" path="/var/lib/kubelet/pods/240adbd5-f80a-4d42-a4d3-befcc024a482/volumes"
Jul 09 18:23:07.679795 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.679764    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"]
Jul 09 18:23:07.680225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.680190    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240adbd5-f80a-4d42-a4d3-befcc024a482" containerName="main"
Jul 09 18:23:07.680225 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.680202    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="240adbd5-f80a-4d42-a4d3-befcc024a482" containerName="main"
Jul 09 18:23:07.680305 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.680258    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="240adbd5-f80a-4d42-a4d3-befcc024a482" containerName="main"
Jul 09 18:23:07.683045 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.683024    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.687155 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.687137    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:23:07.687480 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.687455    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Jul 09 18:23:07.687596 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.687470    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:23:07.687596 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.687484    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-4b931143-epp-sa-dockercfg-sgm7c\""
Jul 09 18:23:07.687596 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.687475    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-s8z92\""
Jul 09 18:23:07.691192 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.691171    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"]
Jul 09 18:23:07.842593 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.842560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2ecbdf52-4644-42b4-b1b4-572c509bab87-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.842799 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.842616    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lltg6\" (UniqueName: \"kubernetes.io/projected/2ecbdf52-4644-42b4-b1b4-572c509bab87-kube-api-access-lltg6\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.842799 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.842712    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ecbdf52-4644-42b4-b1b4-572c509bab87-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.944302 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.944213    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ecbdf52-4644-42b4-b1b4-572c509bab87-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.944302 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.944277    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2ecbdf52-4644-42b4-b1b4-572c509bab87-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.944544 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.944321    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lltg6\" (UniqueName: \"kubernetes.io/projected/2ecbdf52-4644-42b4-b1b4-572c509bab87-kube-api-access-lltg6\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.944757 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.944734    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2ecbdf52-4644-42b4-b1b4-572c509bab87-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.946718 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.946695    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ecbdf52-4644-42b4-b1b4-572c509bab87-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.952948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.952910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lltg6\" (UniqueName: \"kubernetes.io/projected/2ecbdf52-4644-42b4-b1b4-572c509bab87-kube-api-access-lltg6\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:07.993837 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:07.993806    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:08.134019 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:08.133988    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"]
Jul 09 18:23:08.135524 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:23:08.135487    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecbdf52_4644_42b4_b1b4_572c509bab87.slice/crio-efebaf9c409fd63430bd25254604486bd90a3b035f8e0ea3c55b31c18f791a8e WatchSource:0}: Error finding container efebaf9c409fd63430bd25254604486bd90a3b035f8e0ea3c55b31c18f791a8e: Status 404 returned error can't find the container with id efebaf9c409fd63430bd25254604486bd90a3b035f8e0ea3c55b31c18f791a8e
Jul 09 18:23:08.832646 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:08.832614    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf" event={"ID":"2ecbdf52-4644-42b4-b1b4-572c509bab87","Type":"ContainerStarted","Data":"5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1"}
Jul 09 18:23:08.833094 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:08.832662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf" event={"ID":"2ecbdf52-4644-42b4-b1b4-572c509bab87","Type":"ContainerStarted","Data":"efebaf9c409fd63430bd25254604486bd90a3b035f8e0ea3c55b31c18f791a8e"}
Jul 09 18:23:08.833094 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:08.832749    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:23:08.856846 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:08.856797    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf" podStartSLOduration=1.856782194 podStartE2EDuration="1.856782194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:23:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:23:08.854909241 +0000 UTC m=+1110.353966000" watchObservedRunningTime="2026-07-09 18:23:08.856782194 +0000 UTC m=+1110.355838941"
Jul 09 18:23:39.839980 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:23:39.839951    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:24:39.062142 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:24:39.062114    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:24:39.064868 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:24:39.064844    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:25:47.092818 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.092712    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"]
Jul 09 18:25:47.102464 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:25:47.102429    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:25:47.102464 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:25:47.102464 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:25:47.102464 ip-10-0-131-205 kubenswrapper[2569]:  > containerID="5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1" cmd=["/bin/sleep","15"]
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.102480    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf" message="" err=<
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]:  >
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:25:47.102492    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf" podUID="2ecbdf52-4644-42b4-b1b4-572c509bab87" containerName="main" containerID="cri-o://5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1"
Jul 09 18:25:47.102689 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.102538    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf" podUID="2ecbdf52-4644-42b4-b1b4-572c509bab87" containerName="main" containerID="cri-o://5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1" gracePeriod=60
Jul 09 18:25:47.379944 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.379919    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:25:47.479561 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.479527    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2ecbdf52-4644-42b4-b1b4-572c509bab87-tokenizer-uds\") pod \"2ecbdf52-4644-42b4-b1b4-572c509bab87\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") "
Jul 09 18:25:47.479561 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.479566    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ecbdf52-4644-42b4-b1b4-572c509bab87-tls-certs\") pod \"2ecbdf52-4644-42b4-b1b4-572c509bab87\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") "
Jul 09 18:25:47.479780 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.479585    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lltg6\" (UniqueName: \"kubernetes.io/projected/2ecbdf52-4644-42b4-b1b4-572c509bab87-kube-api-access-lltg6\") pod \"2ecbdf52-4644-42b4-b1b4-572c509bab87\" (UID: \"2ecbdf52-4644-42b4-b1b4-572c509bab87\") "
Jul 09 18:25:47.479817 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.479784    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ecbdf52-4644-42b4-b1b4-572c509bab87-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "2ecbdf52-4644-42b4-b1b4-572c509bab87" (UID: "2ecbdf52-4644-42b4-b1b4-572c509bab87"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:25:47.479936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.479918    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2ecbdf52-4644-42b4-b1b4-572c509bab87-tokenizer-uds\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:25:47.481700 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.481674    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ecbdf52-4644-42b4-b1b4-572c509bab87-kube-api-access-lltg6" (OuterVolumeSpecName: "kube-api-access-lltg6") pod "2ecbdf52-4644-42b4-b1b4-572c509bab87" (UID: "2ecbdf52-4644-42b4-b1b4-572c509bab87"). InnerVolumeSpecName "kube-api-access-lltg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:25:47.481820 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.481716    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ecbdf52-4644-42b4-b1b4-572c509bab87-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ecbdf52-4644-42b4-b1b4-572c509bab87" (UID: "2ecbdf52-4644-42b4-b1b4-572c509bab87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:25:47.580847 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.580815    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ecbdf52-4644-42b4-b1b4-572c509bab87-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:25:47.580847 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.580840    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lltg6\" (UniqueName: \"kubernetes.io/projected/2ecbdf52-4644-42b4-b1b4-572c509bab87-kube-api-access-lltg6\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:25:47.723455 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.723367    2569 generic.go:356] "Generic (PLEG): container finished" podID="2ecbdf52-4644-42b4-b1b4-572c509bab87" containerID="5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1" exitCode=0
Jul 09 18:25:47.723455 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.723416    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"
Jul 09 18:25:47.723637 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.723456    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf" event={"ID":"2ecbdf52-4644-42b4-b1b4-572c509bab87","Type":"ContainerDied","Data":"5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1"}
Jul 09 18:25:47.723637 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.723510    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf" event={"ID":"2ecbdf52-4644-42b4-b1b4-572c509bab87","Type":"ContainerDied","Data":"efebaf9c409fd63430bd25254604486bd90a3b035f8e0ea3c55b31c18f791a8e"}
Jul 09 18:25:47.723637 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.723531    2569 scope.go:117] "RemoveContainer" containerID="5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1"
Jul 09 18:25:47.733341 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.733318    2569 scope.go:117] "RemoveContainer" containerID="5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1"
Jul 09 18:25:47.733669 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:25:47.733648    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1\": container with ID starting with 5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1 not found: ID does not exist" containerID="5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1"
Jul 09 18:25:47.733749 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.733683    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1"} err="failed to get container status \"5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1\": rpc error: code = NotFound desc = could not find container \"5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1\": container with ID starting with 5ca8d774802f2060ce2780c72d43af8b4c852d6ac84d6567df3b0a58127d36f1 not found: ID does not exist"
Jul 09 18:25:47.759322 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.759251    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"]
Jul 09 18:25:47.770975 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:47.770934    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schen6mqf"]
Jul 09 18:25:49.121838 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:25:49.121806    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ecbdf52-4644-42b4-b1b4-572c509bab87" path="/var/lib/kubelet/pods/2ecbdf52-4644-42b4-b1b4-572c509bab87/volumes"
Jul 09 18:27:03.421452 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.421369    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"]
Jul 09 18:27:03.421955 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.421918    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ecbdf52-4644-42b4-b1b4-572c509bab87" containerName="main"
Jul 09 18:27:03.421955 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.421950    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ecbdf52-4644-42b4-b1b4-572c509bab87" containerName="main"
Jul 09 18:27:03.422121 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.422105    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ecbdf52-4644-42b4-b1b4-572c509bab87" containerName="main"
Jul 09 18:27:03.427194 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.427166    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.430255 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.430227    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:27:03.430809 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.430789    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-7sv49\""
Jul 09 18:27:03.431534 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.431509    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:27:03.431653 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.431554    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:27:03.441645 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.441599    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"]
Jul 09 18:27:03.561736 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.561697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.561736 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.561736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7fzw\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-kube-api-access-r7fzw\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.561954 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.561817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.561954 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.561866    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.561954 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.561928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.562083 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.561962    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.562083 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.562002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.562083 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.562029    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.562189 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.562104    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663499 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663461    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663706 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663706 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663706 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663550    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663706 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663966 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663740    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663966 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663765    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7fzw\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-kube-api-access-r7fzw\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663966 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663851    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663966 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663875    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.663966 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.663936    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.664282 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.664208    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.664362 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.664285    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.664362 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.664347    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.664517 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.664492    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.665924 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.665904    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.666276 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.666258    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.672646 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.672588    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.672646 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.672617    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7fzw\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-kube-api-access-r7fzw\") pod \"router-gateway-1-openshift-default-799f46c59b-zpwdc\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.739286 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.739249    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:03.921174 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.921150    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"]
Jul 09 18:27:03.922957 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:27:03.922894    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587dadf8_a5d1_4155_bcdd_250e9b0c0fce.slice/crio-7d6b2ea754581a5fad95b4ea2e61c84a3028ac776efe917cdd4c23da4956be9f WatchSource:0}: Error finding container 7d6b2ea754581a5fad95b4ea2e61c84a3028ac776efe917cdd4c23da4956be9f: Status 404 returned error can't find the container with id 7d6b2ea754581a5fad95b4ea2e61c84a3028ac776efe917cdd4c23da4956be9f
Jul 09 18:27:03.924875 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.924841    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:27:03.924958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.924925    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:27:03.924958 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:03.924953    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:27:04.176512 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:04.176157    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc" event={"ID":"587dadf8-a5d1-4155-bcdd-250e9b0c0fce","Type":"ContainerStarted","Data":"843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35"}
Jul 09 18:27:04.176512 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:04.176228    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc" event={"ID":"587dadf8-a5d1-4155-bcdd-250e9b0c0fce","Type":"ContainerStarted","Data":"7d6b2ea754581a5fad95b4ea2e61c84a3028ac776efe917cdd4c23da4956be9f"}
Jul 09 18:27:04.205956 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:04.205892    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc" podStartSLOduration=1.205856734 podStartE2EDuration="1.205856734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:27:04.205005435 +0000 UTC m=+1345.704062182" watchObservedRunningTime="2026-07-09 18:27:04.205856734 +0000 UTC m=+1345.704913483"
Jul 09 18:27:04.367969 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:04.367925    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"]
Jul 09 18:27:04.740288 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:04.740252    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:04.745752 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:04.745724    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:05.181892 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:05.181845    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:05.182891 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:05.182866    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:06.187815 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:06.187769    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc" podUID="587dadf8-a5d1-4155-bcdd-250e9b0c0fce" containerName="istio-proxy" containerID="cri-o://843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35" gracePeriod=30
Jul 09 18:27:11.454352 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.454275    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:11.541404 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541367    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istiod-ca-cert\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541632 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541414    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-socket\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541632 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541440    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-data\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541632 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541488    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-credential-socket\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541632 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541544    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-podinfo\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541632 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541571    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-envoy\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541632 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541626    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7fzw\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-kube-api-access-r7fzw\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541668    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-token\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541745    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-certs\") pod \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\" (UID: \"587dadf8-a5d1-4155-bcdd-250e9b0c0fce\") "
Jul 09 18:27:11.541936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541801    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-data" (OuterVolumeSpecName: "istio-data") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:27:11.541936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541839    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:27:11.541936 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.541844    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:27:11.542175 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.542041    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:27:11.542175 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.542148    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istiod-ca-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:11.542175 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.542168    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-data\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:11.542319 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.542184    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-credential-socket\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:11.542319 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.542200    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:11.542319 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.542204    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:27:11.543876 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.543840    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:27:11.544029 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.543978    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-kube-api-access-r7fzw" (OuterVolumeSpecName: "kube-api-access-r7fzw") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "kube-api-access-r7fzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:27:11.544290 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.544268    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:27:11.544290 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.544279    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-token" (OuterVolumeSpecName: "istio-token") pod "587dadf8-a5d1-4155-bcdd-250e9b0c0fce" (UID: "587dadf8-a5d1-4155-bcdd-250e9b0c0fce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:27:11.643292 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.643261    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-podinfo\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:11.643292 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.643289    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-envoy\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:11.643292 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.643298    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7fzw\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-kube-api-access-r7fzw\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:11.643292 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.643307    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-istio-token\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:11.643575 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:11.643323    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587dadf8-a5d1-4155-bcdd-250e9b0c0fce-workload-socket\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:27:12.228210 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.228175    2569 generic.go:356] "Generic (PLEG): container finished" podID="587dadf8-a5d1-4155-bcdd-250e9b0c0fce" containerID="843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35" exitCode=0
Jul 09 18:27:12.228420 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.228231    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"
Jul 09 18:27:12.228420 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.228266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc" event={"ID":"587dadf8-a5d1-4155-bcdd-250e9b0c0fce","Type":"ContainerDied","Data":"843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35"}
Jul 09 18:27:12.228420 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.228335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc" event={"ID":"587dadf8-a5d1-4155-bcdd-250e9b0c0fce","Type":"ContainerDied","Data":"7d6b2ea754581a5fad95b4ea2e61c84a3028ac776efe917cdd4c23da4956be9f"}
Jul 09 18:27:12.228420 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.228365    2569 scope.go:117] "RemoveContainer" containerID="843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35"
Jul 09 18:27:12.239342 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.239320    2569 scope.go:117] "RemoveContainer" containerID="843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35"
Jul 09 18:27:12.239610 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:27:12.239590    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35\": container with ID starting with 843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35 not found: ID does not exist" containerID="843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35"
Jul 09 18:27:12.239705 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.239621    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35"} err="failed to get container status \"843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35\": rpc error: code = NotFound desc = could not find container \"843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35\": container with ID starting with 843ada30a49102ff4f7ff00938773b936b5c3df774fe19d0dc498188a8f2bf35 not found: ID does not exist"
Jul 09 18:27:12.266100 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.266048    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"]
Jul 09 18:27:12.277999 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:12.277967    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-zpwdc"]
Jul 09 18:27:13.122601 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:27:13.122566    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="587dadf8-a5d1-4155-bcdd-250e9b0c0fce" path="/var/lib/kubelet/pods/587dadf8-a5d1-4155-bcdd-250e9b0c0fce/volumes"
Jul 09 18:28:21.631192 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:21.631139    2569 generic.go:356] "Generic (PLEG): container finished" podID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerID="f5f62688e48c2bed7ed6948a5baeb1652e27722f480c6c7b8ec9d8c1e4b1d7c8" exitCode=137
Jul 09 18:28:21.631674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:21.631188    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" event={"ID":"fb8342bd-81ef-451a-81a1-8f8fe26e6108","Type":"ContainerDied","Data":"f5f62688e48c2bed7ed6948a5baeb1652e27722f480c6c7b8ec9d8c1e4b1d7c8"}
Jul 09 18:28:21.631674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:21.631268    2569 scope.go:117] "RemoveContainer" containerID="6300db07e80393885932896eb21052bf6256e9a5405b6a34f4f50bb1d1832acd"
Jul 09 18:28:21.631674 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:21.631666    2569 scope.go:117] "RemoveContainer" containerID="f5f62688e48c2bed7ed6948a5baeb1652e27722f480c6c7b8ec9d8c1e4b1d7c8"
Jul 09 18:28:21.633274 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:21.633244    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:28:21.633380 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:21.633334    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:28:21.633425 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:21.633380    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:28:22.639779 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:22.639744    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" event={"ID":"fb8342bd-81ef-451a-81a1-8f8fe26e6108","Type":"ContainerStarted","Data":"11c53903c95fbe624785125d53f639bd602c7d0ddb8ee7f804a15c0292cfe575"}
Jul 09 18:28:23.057159 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:23.057038    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:28:23.057325 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:23.057287    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:28:23.057383 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:23.057345    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:28:24.057079 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:24.057024    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:28:24.057483 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:24.057107    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:28:25.056758 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:25.056724    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:28:25.056943 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:25.056778    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:28:26.056611 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:26.056576    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:28:26.057026 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:26.056631    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:28:27.057340 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:27.057304    2569 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:28:27.057933 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:27.057357    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9" podUID="fb8342bd-81ef-451a-81a1-8f8fe26e6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 18:28:28.812209 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:28.812152    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:28:28.812705 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:28.812660    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:28:28.813791 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:28:28.813771    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-p4tn9"
Jul 09 18:29:39.098924 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:29:39.098894    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:29:39.102882 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:29:39.102859    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:34:10.103180 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.103148    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"]
Jul 09 18:34:10.103658 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.103600    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="587dadf8-a5d1-4155-bcdd-250e9b0c0fce" containerName="istio-proxy"
Jul 09 18:34:10.103658 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.103619    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="587dadf8-a5d1-4155-bcdd-250e9b0c0fce" containerName="istio-proxy"
Jul 09 18:34:10.103774 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.103760    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="587dadf8-a5d1-4155-bcdd-250e9b0c0fce" containerName="istio-proxy"
Jul 09 18:34:10.107135 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.107116    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.109952 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.109934    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:34:10.110102 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.109969    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-7sv49\""
Jul 09 18:34:10.110102 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.109991    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:34:10.110240 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.110113    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:34:10.120285 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.120259    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"]
Jul 09 18:34:10.177223 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.177193    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw5r2\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-kube-api-access-lw5r2\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.177388 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.177242    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.177388 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.177278    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.177388 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.177319    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.177867 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.177832    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98af40d-e04d-4080-babe-c202ce145191-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.177998 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.177974    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.178234 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.178212    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.178319 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.178255    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98af40d-e04d-4080-babe-c202ce145191-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.178319 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.178303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279101 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw5r2\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-kube-api-access-lw5r2\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279283 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279283 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279283 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279283 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98af40d-e04d-4080-babe-c202ce145191-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279283 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279588 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279588 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279322    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98af40d-e04d-4080-babe-c202ce145191-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279588 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279360    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279588 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279577    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279808 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279700    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279808 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279769    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.279925 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.279804    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.280027 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.280008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98af40d-e04d-4080-babe-c202ce145191-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.281516 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.281497    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.281738 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.281720    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98af40d-e04d-4080-babe-c202ce145191-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.289532 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.289510    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.289792 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.289770    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw5r2\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-kube-api-access-lw5r2\") pod \"router-gateway-1-openshift-default-799f46c59b-gwjtm\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.420595 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.420510    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:10.558109 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.558086    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"]
Jul 09 18:34:10.559813 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:34:10.559786    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98af40d_e04d_4080_babe_c202ce145191.slice/crio-d1505c183fca6332d67210020a39ac0071030df1480dd0ef3fc63f2479244153 WatchSource:0}: Error finding container d1505c183fca6332d67210020a39ac0071030df1480dd0ef3fc63f2479244153: Status 404 returned error can't find the container with id d1505c183fca6332d67210020a39ac0071030df1480dd0ef3fc63f2479244153
Jul 09 18:34:10.562352 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.562312    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:34:10.562478 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.562379    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:34:10.562478 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.562408    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:34:10.590744 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:10.590720    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm" event={"ID":"c98af40d-e04d-4080-babe-c202ce145191","Type":"ContainerStarted","Data":"d1505c183fca6332d67210020a39ac0071030df1480dd0ef3fc63f2479244153"}
Jul 09 18:34:11.597348 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:11.597311    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm" event={"ID":"c98af40d-e04d-4080-babe-c202ce145191","Type":"ContainerStarted","Data":"d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48"}
Jul 09 18:34:11.622802 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:11.622745    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm" podStartSLOduration=1.622730615 podStartE2EDuration="1.622730615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:34:11.620862862 +0000 UTC m=+1773.119919632" watchObservedRunningTime="2026-07-09 18:34:11.622730615 +0000 UTC m=+1773.121787361"
Jul 09 18:34:12.420874 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:12.420830    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:12.425695 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:12.425673    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:12.602835 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:12.602804    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:12.603699 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:12.603681    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:14.728373 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:14.728342    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"]
Jul 09 18:34:15.626937 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:15.626886    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm" podUID="c98af40d-e04d-4080-babe-c202ce145191" containerName="istio-proxy" containerID="cri-o://d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48" gracePeriod=30
Jul 09 18:34:23.379024 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.378970    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:23.504796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.504763    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98af40d-e04d-4080-babe-c202ce145191-istiod-ca-cert\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.504796 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.504801    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-credential-socket\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.505080 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.504824    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-socket\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.505080 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.504882    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw5r2\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-kube-api-access-lw5r2\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.505080 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.504910    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-istio-token\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.505080 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.504927    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-data\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.505080 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.504984    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-envoy\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.505080 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.505005    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98af40d-e04d-4080-babe-c202ce145191-istio-podinfo\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.505080 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.505035    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-certs\") pod \"c98af40d-e04d-4080-babe-c202ce145191\" (UID: \"c98af40d-e04d-4080-babe-c202ce145191\") "
Jul 09 18:34:23.505556 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.505134    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:34:23.505556 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.505318    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-data" (OuterVolumeSpecName: "istio-data") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:34:23.505556 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.505353    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c98af40d-e04d-4080-babe-c202ce145191-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:34:23.505556 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.505363    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-credential-socket\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.505556 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.505473    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:34:23.505556 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.505501    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:34:23.507507 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.507478    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-istio-token" (OuterVolumeSpecName: "istio-token") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:34:23.507619 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.507548    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c98af40d-e04d-4080-babe-c202ce145191-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:34:23.507668 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.507614    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-kube-api-access-lw5r2" (OuterVolumeSpecName: "kube-api-access-lw5r2") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "kube-api-access-lw5r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:34:23.507746 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.507729    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c98af40d-e04d-4080-babe-c202ce145191" (UID: "c98af40d-e04d-4080-babe-c202ce145191"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:34:23.605995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.605967    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-istio-token\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.605995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.605996    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-data\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.605995 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.606008    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-istio-envoy\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.606213 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.606020    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98af40d-e04d-4080-babe-c202ce145191-istio-podinfo\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.606213 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.606032    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.606213 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.606041    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98af40d-e04d-4080-babe-c202ce145191-istiod-ca-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.606213 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.606048    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98af40d-e04d-4080-babe-c202ce145191-workload-socket\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.606213 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.606084    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw5r2\" (UniqueName: \"kubernetes.io/projected/c98af40d-e04d-4080-babe-c202ce145191-kube-api-access-lw5r2\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:34:23.676612 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.676528    2569 generic.go:356] "Generic (PLEG): container finished" podID="c98af40d-e04d-4080-babe-c202ce145191" containerID="d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48" exitCode=0
Jul 09 18:34:23.676612 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.676569    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"
Jul 09 18:34:23.676612 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.676593    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm" event={"ID":"c98af40d-e04d-4080-babe-c202ce145191","Type":"ContainerDied","Data":"d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48"}
Jul 09 18:34:23.676918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.676641    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm" event={"ID":"c98af40d-e04d-4080-babe-c202ce145191","Type":"ContainerDied","Data":"d1505c183fca6332d67210020a39ac0071030df1480dd0ef3fc63f2479244153"}
Jul 09 18:34:23.676918 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.676669    2569 scope.go:117] "RemoveContainer" containerID="d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48"
Jul 09 18:34:23.688012 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.687988    2569 scope.go:117] "RemoveContainer" containerID="d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48"
Jul 09 18:34:23.688368 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:34:23.688347    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48\": container with ID starting with d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48 not found: ID does not exist" containerID="d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48"
Jul 09 18:34:23.688444 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.688379    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48"} err="failed to get container status \"d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48\": rpc error: code = NotFound desc = could not find container \"d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48\": container with ID starting with d5a836c94bfc439b1923cfa10dffa82c15f6178761761245954ae16b698dde48 not found: ID does not exist"
Jul 09 18:34:23.710200 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.710174    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"]
Jul 09 18:34:23.719879 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:23.719851    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gwjtm"]
Jul 09 18:34:25.129732 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:25.129702    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98af40d-e04d-4080-babe-c202ce145191" path="/var/lib/kubelet/pods/c98af40d-e04d-4080-babe-c202ce145191/volumes"
Jul 09 18:34:39.147213 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:39.147184    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:34:39.154141 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:34:39.154117    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:39:39.182111 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:39:39.182086    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:39:39.190900 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:39:39.190876    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:44:39.218318 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:39.218200    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:44:39.227323 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:39.227304    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:44:47.936123 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.936092    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"]
Jul 09 18:44:47.936498 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.936485    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98af40d-e04d-4080-babe-c202ce145191" containerName="istio-proxy"
Jul 09 18:44:47.936541 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.936501    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98af40d-e04d-4080-babe-c202ce145191" containerName="istio-proxy"
Jul 09 18:44:47.936578 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.936571    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98af40d-e04d-4080-babe-c202ce145191" containerName="istio-proxy"
Jul 09 18:44:47.939622 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.939605    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:47.943369 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.943349    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:44:47.943369 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.943364    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:44:47.943545 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.943355    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:44:47.943679 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.943664    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-q8vnq\""
Jul 09 18:44:47.952439 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:47.952416    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"]
Jul 09 18:44:48.025960 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.025927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193b1f77-451e-482e-b890-fe75b4615015-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.025960 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.025965    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.026199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.026001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.026199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.026027    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.026199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.026091    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95m8r\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-kube-api-access-95m8r\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.026199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.026110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.026199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.026130    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.026199 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.026181    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193b1f77-451e-482e-b890-fe75b4615015-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.026414 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.026206    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127268 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193b1f77-451e-482e-b890-fe75b4615015-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127268 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127272    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127483 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127483 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127315    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127483 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95m8r\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-kube-api-access-95m8r\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127483 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127397    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127483 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127748 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127517    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193b1f77-451e-482e-b890-fe75b4615015-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127748 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127561    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127748 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127919 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127829    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127919 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127894    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.127919 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.128107 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.127991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193b1f77-451e-482e-b890-fe75b4615015-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.129785 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.129764    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.130205 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.130183    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193b1f77-451e-482e-b890-fe75b4615015-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.144556 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.144537    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95m8r\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-kube-api-access-95m8r\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.145948 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.145931    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-lmx5l\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.250981 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.250897    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:48.392175 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.392153    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"]
Jul 09 18:44:48.394167 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:44:48.394137    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193b1f77_451e_482e_b890_fe75b4615015.slice/crio-48d55f6300793991ee91d739f7d8c733cd28977b5fc4054ed557caaf3615a93e WatchSource:0}: Error finding container 48d55f6300793991ee91d739f7d8c733cd28977b5fc4054ed557caaf3615a93e: Status 404 returned error can't find the container with id 48d55f6300793991ee91d739f7d8c733cd28977b5fc4054ed557caaf3615a93e
Jul 09 18:44:48.396215 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.396180    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:44:48.396316 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.396245    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:44:48.396316 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:48.396273    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:44:49.080534 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:49.080495    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l" event={"ID":"193b1f77-451e-482e-b890-fe75b4615015","Type":"ContainerStarted","Data":"c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b"}
Jul 09 18:44:49.080941 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:49.080561    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l" event={"ID":"193b1f77-451e-482e-b890-fe75b4615015","Type":"ContainerStarted","Data":"48d55f6300793991ee91d739f7d8c733cd28977b5fc4054ed557caaf3615a93e"}
Jul 09 18:44:49.106264 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:49.106207    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l" podStartSLOduration=2.106191212 podStartE2EDuration="2.106191212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:44:49.104520193 +0000 UTC m=+2410.603576944" watchObservedRunningTime="2026-07-09 18:44:49.106191212 +0000 UTC m=+2410.605248015"
Jul 09 18:44:49.251328 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:49.251299    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:49.256256 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:49.256234    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:50.086876 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:50.086845    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:50.087973 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:50.087954    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:52.934432 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:52.934400    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"]
Jul 09 18:44:53.104181 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:53.104128    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l" podUID="193b1f77-451e-482e-b890-fe75b4615015" containerName="istio-proxy" containerID="cri-o://c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b" gracePeriod=30
Jul 09 18:44:58.357481 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.357456    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:58.541741 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541648    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-socket\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.541741 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541685    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-envoy\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.541741 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541706    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-certs\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.541741 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541730    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-credential-socket\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.542110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541772    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95m8r\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-kube-api-access-95m8r\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.542110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541833    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193b1f77-451e-482e-b890-fe75b4615015-istiod-ca-cert\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.542110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541856    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193b1f77-451e-482e-b890-fe75b4615015-istio-podinfo\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.542110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541909    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-data\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.542110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541936    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-istio-token\") pod \"193b1f77-451e-482e-b890-fe75b4615015\" (UID: \"193b1f77-451e-482e-b890-fe75b4615015\") "
Jul 09 18:44:58.542110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.541996    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:44:58.542110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.542014    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:44:58.542110 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.542082    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:44:58.542531 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.542223    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-data" (OuterVolumeSpecName: "istio-data") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:44:58.542531 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.542285    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-credential-socket\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:58.542531 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.542300    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-socket\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:58.542531 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.542310    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-workload-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:58.542531 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.542438    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/193b1f77-451e-482e-b890-fe75b4615015-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:44:58.543921 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.543892    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:44:58.544069 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.543994    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-kube-api-access-95m8r" (OuterVolumeSpecName: "kube-api-access-95m8r") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "kube-api-access-95m8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:44:58.544373 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.544347    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-istio-token" (OuterVolumeSpecName: "istio-token") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:44:58.544373 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.544351    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/193b1f77-451e-482e-b890-fe75b4615015-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "193b1f77-451e-482e-b890-fe75b4615015" (UID: "193b1f77-451e-482e-b890-fe75b4615015"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:44:58.642704 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.642672    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193b1f77-451e-482e-b890-fe75b4615015-istiod-ca-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:58.642704 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.642697    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193b1f77-451e-482e-b890-fe75b4615015-istio-podinfo\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:58.642704 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.642705    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-data\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:58.642924 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.642713    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-istio-token\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:58.642924 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.642721    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193b1f77-451e-482e-b890-fe75b4615015-istio-envoy\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:58.642924 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:58.642729    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95m8r\" (UniqueName: \"kubernetes.io/projected/193b1f77-451e-482e-b890-fe75b4615015-kube-api-access-95m8r\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 18:44:59.149401 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.149371    2569 generic.go:356] "Generic (PLEG): container finished" podID="193b1f77-451e-482e-b890-fe75b4615015" containerID="c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b" exitCode=0
Jul 09 18:44:59.149515 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.149416    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"
Jul 09 18:44:59.149515 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.149461    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l" event={"ID":"193b1f77-451e-482e-b890-fe75b4615015","Type":"ContainerDied","Data":"c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b"}
Jul 09 18:44:59.149597 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.149517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l" event={"ID":"193b1f77-451e-482e-b890-fe75b4615015","Type":"ContainerDied","Data":"48d55f6300793991ee91d739f7d8c733cd28977b5fc4054ed557caaf3615a93e"}
Jul 09 18:44:59.149597 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.149546    2569 scope.go:117] "RemoveContainer" containerID="c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b"
Jul 09 18:44:59.158331 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.158276    2569 scope.go:117] "RemoveContainer" containerID="c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b"
Jul 09 18:44:59.158581 ip-10-0-131-205 kubenswrapper[2569]: E0709 18:44:59.158562    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b\": container with ID starting with c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b not found: ID does not exist" containerID="c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b"
Jul 09 18:44:59.158661 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.158591    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b"} err="failed to get container status \"c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b\": rpc error: code = NotFound desc = could not find container \"c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b\": container with ID starting with c7a01a99866660a31c814a46576b9a71d34cc799abe380b1a7c3c14dbffaaf5b not found: ID does not exist"
Jul 09 18:44:59.169903 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.169883    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"]
Jul 09 18:44:59.173961 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:44:59.173941    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-lmx5l"]
Jul 09 18:45:01.123171 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:45:01.123094    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="193b1f77-451e-482e-b890-fe75b4615015" path="/var/lib/kubelet/pods/193b1f77-451e-482e-b890-fe75b4615015/volumes"
Jul 09 18:46:57.991727 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.991689    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"]
Jul 09 18:46:57.992242 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.992138    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193b1f77-451e-482e-b890-fe75b4615015" containerName="istio-proxy"
Jul 09 18:46:57.992242 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.992152    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="193b1f77-451e-482e-b890-fe75b4615015" containerName="istio-proxy"
Jul 09 18:46:57.992242 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.992236    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="193b1f77-451e-482e-b890-fe75b4615015" containerName="istio-proxy"
Jul 09 18:46:57.994979 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.994956    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:57.998100 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.998048    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 18:46:57.998237 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.998148    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 18:46:57.999739 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.999694    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-s8z92\""
Jul 09 18:46:57.999849 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.999786    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-pvc-router-manage-e8706282-epp-sa-dockercfg-ggvbd\""
Jul 09 18:46:57.999849 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:57.999800    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs\""
Jul 09 18:46:58.004315 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.004294    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"]
Jul 09 18:46:58.099824 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.099783    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/39279130-b4d1-4a37-937a-6d88e93dcbaf-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.100012 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.099862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39279130-b4d1-4a37-937a-6d88e93dcbaf-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.100012 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.099914    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv6md\" (UniqueName: \"kubernetes.io/projected/39279130-b4d1-4a37-937a-6d88e93dcbaf-kube-api-access-dv6md\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.201350 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.201312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/39279130-b4d1-4a37-937a-6d88e93dcbaf-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.201568 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.201384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39279130-b4d1-4a37-937a-6d88e93dcbaf-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.201568 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.201433    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv6md\" (UniqueName: \"kubernetes.io/projected/39279130-b4d1-4a37-937a-6d88e93dcbaf-kube-api-access-dv6md\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.201860 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.201836    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/39279130-b4d1-4a37-937a-6d88e93dcbaf-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.203797 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.203777    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39279130-b4d1-4a37-937a-6d88e93dcbaf-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.213004 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.212975    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv6md\" (UniqueName: \"kubernetes.io/projected/39279130-b4d1-4a37-937a-6d88e93dcbaf-kube-api-access-dv6md\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n\" (UID: \"39279130-b4d1-4a37-937a-6d88e93dcbaf\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.305885 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.305756    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.470145 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.470120    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"]
Jul 09 18:46:58.471786 ip-10-0-131-205 kubenswrapper[2569]: W0709 18:46:58.471757    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39279130_b4d1_4a37_937a_6d88e93dcbaf.slice/crio-e71c49eccf7d0febad65c720a417803af81c905257bc3f1d52bcc0af7938daea WatchSource:0}: Error finding container e71c49eccf7d0febad65c720a417803af81c905257bc3f1d52bcc0af7938daea: Status 404 returned error can't find the container with id e71c49eccf7d0febad65c720a417803af81c905257bc3f1d52bcc0af7938daea
Jul 09 18:46:58.788896 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.788856    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n" event={"ID":"39279130-b4d1-4a37-937a-6d88e93dcbaf","Type":"ContainerStarted","Data":"4d158e154f7002ccae8dabc8d99437414cf50d3b5417d9fec1c0ba5b81119159"}
Jul 09 18:46:58.789112 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.788923    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n" event={"ID":"39279130-b4d1-4a37-937a-6d88e93dcbaf","Type":"ContainerStarted","Data":"e71c49eccf7d0febad65c720a417803af81c905257bc3f1d52bcc0af7938daea"}
Jul 09 18:46:58.789112 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.788955    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:46:58.815109 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:46:58.815031    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n" podStartSLOduration=1.815015055 podStartE2EDuration="1.815015055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:58.814660064 +0000 UTC m=+2540.313716813" watchObservedRunningTime="2026-07-09 18:46:58.815015055 +0000 UTC m=+2540.314071864"
Jul 09 18:47:29.796676 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:47:29.796644    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n"
Jul 09 18:49:39.253449 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:49:39.253335    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:49:39.263313 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:49:39.263292    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:54:39.291882 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:54:39.291761    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:54:39.303514 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:54:39.303488    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:59:39.329294 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:59:39.329271    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 18:59:39.345281 ip-10-0-131-205 kubenswrapper[2569]: I0709 18:59:39.345259    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:01:37.472931 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:01:37.472857    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:02:06.005468 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.005427    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"]
Jul 09 19:02:06.009109 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.009087    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.013168 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.013147    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs\""
Jul 09 19:02:06.014471 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.014452    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-pvc-router-manage-2577e794-epp-sa-dockercfg-kbj5n\""
Jul 09 19:02:06.029628 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.029603    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"]
Jul 09 19:02:06.187570 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.187543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3827bc-f94f-44be-8b0e-ba769ef31472-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.187744 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.187576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2f3827bc-f94f-44be-8b0e-ba769ef31472-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.187744 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.187624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44khq\" (UniqueName: \"kubernetes.io/projected/2f3827bc-f94f-44be-8b0e-ba769ef31472-kube-api-access-44khq\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.289081 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.288957    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3827bc-f94f-44be-8b0e-ba769ef31472-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.289081 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.289010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2f3827bc-f94f-44be-8b0e-ba769ef31472-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.289332 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.289120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44khq\" (UniqueName: \"kubernetes.io/projected/2f3827bc-f94f-44be-8b0e-ba769ef31472-kube-api-access-44khq\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.289473 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.289441    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2f3827bc-f94f-44be-8b0e-ba769ef31472-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.291755 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.291734    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3827bc-f94f-44be-8b0e-ba769ef31472-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.303131 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.303090    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44khq\" (UniqueName: \"kubernetes.io/projected/2f3827bc-f94f-44be-8b0e-ba769ef31472-kube-api-access-44khq\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.318748 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.318722    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.462808 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.462775    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"]
Jul 09 19:02:06.464341 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:02:06.464316    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3827bc_f94f_44be_8b0e_ba769ef31472.slice/crio-d72efe99958310d0f3591fa1e8174b91d12bc1c0900db20d85ff7b6280784387 WatchSource:0}: Error finding container d72efe99958310d0f3591fa1e8174b91d12bc1c0900db20d85ff7b6280784387: Status 404 returned error can't find the container with id d72efe99958310d0f3591fa1e8174b91d12bc1c0900db20d85ff7b6280784387
Jul 09 19:02:06.725038 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.724993    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn" event={"ID":"2f3827bc-f94f-44be-8b0e-ba769ef31472","Type":"ContainerStarted","Data":"2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169"}
Jul 09 19:02:06.725256 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.725078    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn" event={"ID":"2f3827bc-f94f-44be-8b0e-ba769ef31472","Type":"ContainerStarted","Data":"d72efe99958310d0f3591fa1e8174b91d12bc1c0900db20d85ff7b6280784387"}
Jul 09 19:02:06.725256 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.725203    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:02:06.754844 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:06.754787    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn" podStartSLOduration=1.754771529 podStartE2EDuration="1.754771529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:02:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:02:06.751488778 +0000 UTC m=+3448.250545527" watchObservedRunningTime="2026-07-09 19:02:06.754771529 +0000 UTC m=+3448.253828275"
Jul 09 19:02:37.732305 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:02:37.732275    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:04:39.369011 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:39.368879    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:04:39.385977 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:39.385949    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:04:51.140503 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.140459    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"]
Jul 09 19:04:51.151392 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:04:51.151352    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 19:04:51.151392 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:04:51.151392 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:04:51.151392 ip-10-0-131-205 kubenswrapper[2569]:  > containerID="2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169" cmd=["/bin/sleep","15"]
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.151407    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn" message="" err=<
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]:  >
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:04:51.151429    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn" podUID="2f3827bc-f94f-44be-8b0e-ba769ef31472" containerName="main" containerID="cri-o://2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169"
Jul 09 19:04:51.151748 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.151468    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn" podUID="2f3827bc-f94f-44be-8b0e-ba769ef31472" containerName="main" containerID="cri-o://2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169" gracePeriod=60
Jul 09 19:04:51.430678 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.430644    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:04:51.503706 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.503668    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2f3827bc-f94f-44be-8b0e-ba769ef31472-tokenizer-uds\") pod \"2f3827bc-f94f-44be-8b0e-ba769ef31472\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") "
Jul 09 19:04:51.503706 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.503715    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3827bc-f94f-44be-8b0e-ba769ef31472-tls-certs\") pod \"2f3827bc-f94f-44be-8b0e-ba769ef31472\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") "
Jul 09 19:04:51.503975 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.503803    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44khq\" (UniqueName: \"kubernetes.io/projected/2f3827bc-f94f-44be-8b0e-ba769ef31472-kube-api-access-44khq\") pod \"2f3827bc-f94f-44be-8b0e-ba769ef31472\" (UID: \"2f3827bc-f94f-44be-8b0e-ba769ef31472\") "
Jul 09 19:04:51.503975 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.503908    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3827bc-f94f-44be-8b0e-ba769ef31472-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "2f3827bc-f94f-44be-8b0e-ba769ef31472" (UID: "2f3827bc-f94f-44be-8b0e-ba769ef31472"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:04:51.506236 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.506206    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f3827bc-f94f-44be-8b0e-ba769ef31472-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f3827bc-f94f-44be-8b0e-ba769ef31472" (UID: "2f3827bc-f94f-44be-8b0e-ba769ef31472"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:04:51.509221 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.509182    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3827bc-f94f-44be-8b0e-ba769ef31472-kube-api-access-44khq" (OuterVolumeSpecName: "kube-api-access-44khq") pod "2f3827bc-f94f-44be-8b0e-ba769ef31472" (UID: "2f3827bc-f94f-44be-8b0e-ba769ef31472"). InnerVolumeSpecName "kube-api-access-44khq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:04:51.605393 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.605360    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f3827bc-f94f-44be-8b0e-ba769ef31472-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:04:51.605393 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.605391    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44khq\" (UniqueName: \"kubernetes.io/projected/2f3827bc-f94f-44be-8b0e-ba769ef31472-kube-api-access-44khq\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:04:51.605393 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.605401    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/2f3827bc-f94f-44be-8b0e-ba769ef31472-tokenizer-uds\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:04:51.659079 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.659020    2569 generic.go:356] "Generic (PLEG): container finished" podID="2f3827bc-f94f-44be-8b0e-ba769ef31472" containerID="2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169" exitCode=0
Jul 09 19:04:51.659247 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.659091    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"
Jul 09 19:04:51.659247 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.659098    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn" event={"ID":"2f3827bc-f94f-44be-8b0e-ba769ef31472","Type":"ContainerDied","Data":"2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169"}
Jul 09 19:04:51.659247 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.659147    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn" event={"ID":"2f3827bc-f94f-44be-8b0e-ba769ef31472","Type":"ContainerDied","Data":"d72efe99958310d0f3591fa1e8174b91d12bc1c0900db20d85ff7b6280784387"}
Jul 09 19:04:51.659247 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.659169    2569 scope.go:117] "RemoveContainer" containerID="2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169"
Jul 09 19:04:51.669292 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.669275    2569 scope.go:117] "RemoveContainer" containerID="2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169"
Jul 09 19:04:51.669564 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:04:51.669548    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169\": container with ID starting with 2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169 not found: ID does not exist" containerID="2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169"
Jul 09 19:04:51.669611 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.669572    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169"} err="failed to get container status \"2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169\": rpc error: code = NotFound desc = could not find container \"2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169\": container with ID starting with 2a90ba0e9743db3b995609431a3b4ce186f5c98665d7a82d914f7e2214891169 not found: ID does not exist"
Jul 09 19:04:51.684878 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.684848    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"]
Jul 09 19:04:51.687071 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:51.687028    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schebwwdn"]
Jul 09 19:04:53.122728 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:04:53.122689    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3827bc-f94f-44be-8b0e-ba769ef31472" path="/var/lib/kubelet/pods/2f3827bc-f94f-44be-8b0e-ba769ef31472/volumes"
Jul 09 19:07:25.076535 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.076504    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"]
Jul 09 19:07:25.076943 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.076890    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3827bc-f94f-44be-8b0e-ba769ef31472" containerName="main"
Jul 09 19:07:25.076943 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.076901    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3827bc-f94f-44be-8b0e-ba769ef31472" containerName="main"
Jul 09 19:07:25.077020 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.076978    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3827bc-f94f-44be-8b0e-ba769ef31472" containerName="main"
Jul 09 19:07:25.079784 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.079763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.082514 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.082492    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Jul 09 19:07:25.093099 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.093074    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"]
Jul 09 19:07:25.206775 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.206743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.206945 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.206791    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.206945 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.206863    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp9bs\" (UniqueName: \"kubernetes.io/projected/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-kube-api-access-rp9bs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.206945 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.206893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.206945 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.206909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.206945 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.206929    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308090 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308029    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp9bs\" (UniqueName: \"kubernetes.io/projected/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-kube-api-access-rp9bs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308263 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308110    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308263 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308263 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308172    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308263 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308481 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308862 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308639    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308862 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308774    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.308862 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.308847    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.310749 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.310730    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.311317 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.311294    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.317617 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.317594    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp9bs\" (UniqueName: \"kubernetes.io/projected/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-kube-api-access-rp9bs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.390804 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.390718    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:25.536638 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:25.536608    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"]
Jul 09 19:07:25.538264 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:07:25.538238    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a559f9_3f4b_41b6_aacb_e76b5c8d6f0d.slice/crio-bdacb2ce58bd6997cc36c42bcecbff659a8b804d8b6e102f561ac3812346bcbc WatchSource:0}: Error finding container bdacb2ce58bd6997cc36c42bcecbff659a8b804d8b6e102f561ac3812346bcbc: Status 404 returned error can't find the container with id bdacb2ce58bd6997cc36c42bcecbff659a8b804d8b6e102f561ac3812346bcbc
Jul 09 19:07:26.533305 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:26.533262    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr" event={"ID":"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d","Type":"ContainerStarted","Data":"408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf"}
Jul 09 19:07:26.533836 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:26.533317    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr" event={"ID":"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d","Type":"ContainerStarted","Data":"bdacb2ce58bd6997cc36c42bcecbff659a8b804d8b6e102f561ac3812346bcbc"}
Jul 09 19:07:27.390831 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:27.390801    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:35.391198 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:35.391118    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:35.403646 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:35.403622    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:07:35.425359 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:35.425312    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr" podStartSLOduration=10.42529679 podStartE2EDuration="10.42529679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:26.570279554 +0000 UTC m=+3768.069336313" watchObservedRunningTime="2026-07-09 19:07:35.42529679 +0000 UTC m=+3776.924353537"
Jul 09 19:07:35.609263 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:07:35.609232    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:08:51.503392 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:08:51.503359    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"]
Jul 09 19:09:06.526243 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.526141    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr" podUID="78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" containerName="main" containerID="cri-o://408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf" gracePeriod=45
Jul 09 19:09:06.597562 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.597530    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr" podUID="78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/health\": dial tcp 10.133.0.53:8000: connect: connection refused"
Jul 09 19:09:06.780524 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.780455    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:09:06.921882 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.921845    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-home\") pod \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") "
Jul 09 19:09:06.922094 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.921891    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tls-certs\") pod \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") "
Jul 09 19:09:06.922094 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.921925    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tmp-dir\") pod \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") "
Jul 09 19:09:06.922094 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.921951    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-dshm\") pod \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") "
Jul 09 19:09:06.922094 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.921979    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp9bs\" (UniqueName: \"kubernetes.io/projected/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-kube-api-access-rp9bs\") pod \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") "
Jul 09 19:09:06.922392 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.922100    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-model-cache\") pod \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\" (UID: \"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d\") "
Jul 09 19:09:06.922392 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.922158    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-home" (OuterVolumeSpecName: "home") pod "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" (UID: "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:09:06.922392 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.922238    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" (UID: "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:09:06.922545 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.922418    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-home\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:09:06.922545 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.922436    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-model-cache" (OuterVolumeSpecName: "model-cache") pod "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" (UID: "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:09:06.922545 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.922462    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tmp-dir\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:09:06.924005 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.923985    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" (UID: "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:09:06.924098 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.924074    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-kube-api-access-rp9bs" (OuterVolumeSpecName: "kube-api-access-rp9bs") pod "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" (UID: "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d"). InnerVolumeSpecName "kube-api-access-rp9bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:09:06.924144 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:06.924128    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-dshm" (OuterVolumeSpecName: "dshm") pod "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" (UID: "78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:09:07.023276 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.023249    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-model-cache\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:09:07.023276 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.023272    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:09:07.023276 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.023280    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-dshm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:09:07.023456 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.023288    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp9bs\" (UniqueName: \"kubernetes.io/projected/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d-kube-api-access-rp9bs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:09:07.127585 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.127553    2569 generic.go:356] "Generic (PLEG): container finished" podID="78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" containerID="408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf" exitCode=0
Jul 09 19:09:07.127754 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.127594    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"
Jul 09 19:09:07.127754 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.127639    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr" event={"ID":"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d","Type":"ContainerDied","Data":"408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf"}
Jul 09 19:09:07.127754 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.127685    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr" event={"ID":"78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d","Type":"ContainerDied","Data":"bdacb2ce58bd6997cc36c42bcecbff659a8b804d8b6e102f561ac3812346bcbc"}
Jul 09 19:09:07.127754 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.127708    2569 scope.go:117] "RemoveContainer" containerID="408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf"
Jul 09 19:09:07.137859 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.137840    2569 scope.go:117] "RemoveContainer" containerID="408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf"
Jul 09 19:09:07.138115 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:09:07.138094    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf\": container with ID starting with 408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf not found: ID does not exist" containerID="408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf"
Jul 09 19:09:07.138202 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.138121    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf"} err="failed to get container status \"408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf\": rpc error: code = NotFound desc = could not find container \"408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf\": container with ID starting with 408a7da688af3dd62cefbcb1d81231cf0c33a03d20889fe418702f2c3a4e46cf not found: ID does not exist"
Jul 09 19:09:07.149137 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.149114    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"]
Jul 09 19:09:07.153758 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:07.153739    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4d72sr"]
Jul 09 19:09:09.123070 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:09.123033    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" path="/var/lib/kubelet/pods/78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d/volumes"
Jul 09 19:09:39.404708 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:39.404586    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:09:39.423552 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:39.423531    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:09:41.075447 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.075411    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"]
Jul 09 19:09:41.075857 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.075809    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" containerName="main"
Jul 09 19:09:41.075857 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.075820    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" containerName="main"
Jul 09 19:09:41.075929 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.075887    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="78a559f9-3f4b-41b6-aacb-e76b5c8d6f0d" containerName="main"
Jul 09 19:09:41.080281 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.080255    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.083107 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.083049    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Jul 09 19:09:41.088601 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.088570    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"]
Jul 09 19:09:41.216327 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.216271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-home\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.216327 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.216323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.216562 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.216415    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-dshm\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.216562 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.216457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2wkr\" (UniqueName: \"kubernetes.io/projected/833ed9c3-fd81-435b-ac03-c73bd75ef98b-kube-api-access-w2wkr\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.216562 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.216519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-model-cache\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.216678 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.216596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.317636 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.317597    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-home\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.317636 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.317633    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.317931 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.317670    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-dshm\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.317931 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.317692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2wkr\" (UniqueName: \"kubernetes.io/projected/833ed9c3-fd81-435b-ac03-c73bd75ef98b-kube-api-access-w2wkr\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.317931 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.317737    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-model-cache\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.317931 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.317787    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.318188 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.318125    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-home\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.318233 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.318215    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-model-cache\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.318268 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.318247    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.320242 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.320205    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-dshm\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.320606 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.320586    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.327568 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.327499    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2wkr\" (UniqueName: \"kubernetes.io/projected/833ed9c3-fd81-435b-ac03-c73bd75ef98b-kube-api-access-w2wkr\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.391902 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.391873    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:41.409792 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.409755    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"]
Jul 09 19:09:41.414565 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.414539    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.417763 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.417737    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-8h9z9\""
Jul 09 19:09:41.417913 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.417733    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"]
Jul 09 19:09:41.519700 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.519655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26v25\" (UniqueName: \"kubernetes.io/projected/8bfba8de-d83f-49a5-8cf4-298f604942e7-kube-api-access-26v25\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.519700 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.519702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8bfba8de-d83f-49a5-8cf4-298f604942e7-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.519974 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.519740    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfba8de-d83f-49a5-8cf4-298f604942e7-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.562866 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.562840    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"]
Jul 09 19:09:41.564219 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:09:41.564191    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833ed9c3_fd81_435b_ac03_c73bd75ef98b.slice/crio-a1aa60cd748c1d0e77da7ebb7767fe4a237d02f3d7b5d4ab3643894b2fde9422 WatchSource:0}: Error finding container a1aa60cd748c1d0e77da7ebb7767fe4a237d02f3d7b5d4ab3643894b2fde9422: Status 404 returned error can't find the container with id a1aa60cd748c1d0e77da7ebb7767fe4a237d02f3d7b5d4ab3643894b2fde9422
Jul 09 19:09:41.620987 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.620951    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26v25\" (UniqueName: \"kubernetes.io/projected/8bfba8de-d83f-49a5-8cf4-298f604942e7-kube-api-access-26v25\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.620987 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.620991    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8bfba8de-d83f-49a5-8cf4-298f604942e7-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.621270 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.621019    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfba8de-d83f-49a5-8cf4-298f604942e7-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.621377 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.621350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8bfba8de-d83f-49a5-8cf4-298f604942e7-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.623583 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.623554    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfba8de-d83f-49a5-8cf4-298f604942e7-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.631165 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.631144    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26v25\" (UniqueName: \"kubernetes.io/projected/8bfba8de-d83f-49a5-8cf4-298f604942e7-kube-api-access-26v25\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.732791 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.732751    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:41.884171 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:41.884143    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"]
Jul 09 19:09:41.886180 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:09:41.886156    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfba8de_d83f_49a5_8cf4_298f604942e7.slice/crio-958511fe0ae5b72d24999ba7f83cb2f944f88c87ef3a38a8159cae0cc8cfff4c WatchSource:0}: Error finding container 958511fe0ae5b72d24999ba7f83cb2f944f88c87ef3a38a8159cae0cc8cfff4c: Status 404 returned error can't find the container with id 958511fe0ae5b72d24999ba7f83cb2f944f88c87ef3a38a8159cae0cc8cfff4c
Jul 09 19:09:42.324909 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:42.324868    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q" event={"ID":"8bfba8de-d83f-49a5-8cf4-298f604942e7","Type":"ContainerStarted","Data":"fba0fd735bb92d9c50dcc0c6320de5eadbecca96a4f32ddc7c834e848c0ab03f"}
Jul 09 19:09:42.325420 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:42.324935    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q" event={"ID":"8bfba8de-d83f-49a5-8cf4-298f604942e7","Type":"ContainerStarted","Data":"958511fe0ae5b72d24999ba7f83cb2f944f88c87ef3a38a8159cae0cc8cfff4c"}
Jul 09 19:09:42.325420 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:42.324976    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:09:42.327162 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:42.327127    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk" event={"ID":"833ed9c3-fd81-435b-ac03-c73bd75ef98b","Type":"ContainerStarted","Data":"9520965f8db14306927a5323e02177804cba386d73bc81f3df3d02cae0946b34"}
Jul 09 19:09:42.327328 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:42.327193    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk" event={"ID":"833ed9c3-fd81-435b-ac03-c73bd75ef98b","Type":"ContainerStarted","Data":"a1aa60cd748c1d0e77da7ebb7767fe4a237d02f3d7b5d4ab3643894b2fde9422"}
Jul 09 19:09:42.352424 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:42.352361    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q" podStartSLOduration=1.352345264 podStartE2EDuration="1.352345264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:09:42.350149297 +0000 UTC m=+3903.849206044" watchObservedRunningTime="2026-07-09 19:09:42.352345264 +0000 UTC m=+3903.851402041"
Jul 09 19:09:42.370815 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:42.370758    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk" podStartSLOduration=1.370742003 podStartE2EDuration="1.370742003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:09:42.370112204 +0000 UTC m=+3903.869168955" watchObservedRunningTime="2026-07-09 19:09:42.370742003 +0000 UTC m=+3903.869798750"
Jul 09 19:09:42.392665 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:42.392624    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:51.392294 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:51.392259    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:51.404860 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:51.404837    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:09:52.396780 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:09:52.396743    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:10:13.335554 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:10:13.335519    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:11:05.621294 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.621255    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"]
Jul 09 19:11:05.628925 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.628889    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"]
Jul 09 19:11:05.633925 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:11:05.633885    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 19:11:05.633925 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:11:05.633925 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:11:05.633925 ip-10-0-131-205 kubenswrapper[2569]:  > containerID="fba0fd735bb92d9c50dcc0c6320de5eadbecca96a4f32ddc7c834e848c0ab03f" cmd=["/bin/sleep","15"]
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.633945    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q" message="" err=<
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]:  >
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:11:05.633959    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q" podUID="8bfba8de-d83f-49a5-8cf4-298f604942e7" containerName="main" containerID="cri-o://fba0fd735bb92d9c50dcc0c6320de5eadbecca96a4f32ddc7c834e848c0ab03f"
Jul 09 19:11:05.634323 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.633998    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q" podUID="8bfba8de-d83f-49a5-8cf4-298f604942e7" containerName="main" containerID="cri-o://fba0fd735bb92d9c50dcc0c6320de5eadbecca96a4f32ddc7c834e848c0ab03f" gracePeriod=60
Jul 09 19:11:05.809604 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.809504    2569 generic.go:356] "Generic (PLEG): container finished" podID="8bfba8de-d83f-49a5-8cf4-298f604942e7" containerID="fba0fd735bb92d9c50dcc0c6320de5eadbecca96a4f32ddc7c834e848c0ab03f" exitCode=0
Jul 09 19:11:05.809604 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.809561    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q" event={"ID":"8bfba8de-d83f-49a5-8cf4-298f604942e7","Type":"ContainerDied","Data":"fba0fd735bb92d9c50dcc0c6320de5eadbecca96a4f32ddc7c834e848c0ab03f"}
Jul 09 19:11:05.892337 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.892309    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:11:05.997199 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.997160    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfba8de-d83f-49a5-8cf4-298f604942e7-tls-certs\") pod \"8bfba8de-d83f-49a5-8cf4-298f604942e7\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") "
Jul 09 19:11:05.997199 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.997204    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8bfba8de-d83f-49a5-8cf4-298f604942e7-tokenizer-uds\") pod \"8bfba8de-d83f-49a5-8cf4-298f604942e7\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") "
Jul 09 19:11:05.997425 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.997285    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26v25\" (UniqueName: \"kubernetes.io/projected/8bfba8de-d83f-49a5-8cf4-298f604942e7-kube-api-access-26v25\") pod \"8bfba8de-d83f-49a5-8cf4-298f604942e7\" (UID: \"8bfba8de-d83f-49a5-8cf4-298f604942e7\") "
Jul 09 19:11:05.997505 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.997479    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bfba8de-d83f-49a5-8cf4-298f604942e7-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "8bfba8de-d83f-49a5-8cf4-298f604942e7" (UID: "8bfba8de-d83f-49a5-8cf4-298f604942e7"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:05.999403 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.999370    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bfba8de-d83f-49a5-8cf4-298f604942e7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8bfba8de-d83f-49a5-8cf4-298f604942e7" (UID: "8bfba8de-d83f-49a5-8cf4-298f604942e7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:11:05.999536 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:05.999413    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bfba8de-d83f-49a5-8cf4-298f604942e7-kube-api-access-26v25" (OuterVolumeSpecName: "kube-api-access-26v25") pod "8bfba8de-d83f-49a5-8cf4-298f604942e7" (UID: "8bfba8de-d83f-49a5-8cf4-298f604942e7"). InnerVolumeSpecName "kube-api-access-26v25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:11:06.098395 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:06.098359    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfba8de-d83f-49a5-8cf4-298f604942e7-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:06.098395 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:06.098388    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8bfba8de-d83f-49a5-8cf4-298f604942e7-tokenizer-uds\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:06.098395 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:06.098398    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26v25\" (UniqueName: \"kubernetes.io/projected/8bfba8de-d83f-49a5-8cf4-298f604942e7-kube-api-access-26v25\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:06.816807 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:06.816774    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q" event={"ID":"8bfba8de-d83f-49a5-8cf4-298f604942e7","Type":"ContainerDied","Data":"958511fe0ae5b72d24999ba7f83cb2f944f88c87ef3a38a8159cae0cc8cfff4c"}
Jul 09 19:11:06.817257 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:06.816831    2569 scope.go:117] "RemoveContainer" containerID="fba0fd735bb92d9c50dcc0c6320de5eadbecca96a4f32ddc7c834e848c0ab03f"
Jul 09 19:11:06.817257 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:06.816782    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"
Jul 09 19:11:06.841347 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:06.841314    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"]
Jul 09 19:11:06.845219 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:06.845183    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87vnq7q"]
Jul 09 19:11:07.122400 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:07.122360    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bfba8de-d83f-49a5-8cf4-298f604942e7" path="/var/lib/kubelet/pods/8bfba8de-d83f-49a5-8cf4-298f604942e7/volumes"
Jul 09 19:11:20.658780 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:20.658734    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk" podUID="833ed9c3-fd81-435b-ac03-c73bd75ef98b" containerName="main" containerID="cri-o://9520965f8db14306927a5323e02177804cba386d73bc81f3df3d02cae0946b34" gracePeriod=45
Jul 09 19:11:20.896822 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:20.896782    2569 generic.go:356] "Generic (PLEG): container finished" podID="833ed9c3-fd81-435b-ac03-c73bd75ef98b" containerID="9520965f8db14306927a5323e02177804cba386d73bc81f3df3d02cae0946b34" exitCode=0
Jul 09 19:11:20.897001 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:20.896834    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk" event={"ID":"833ed9c3-fd81-435b-ac03-c73bd75ef98b","Type":"ContainerDied","Data":"9520965f8db14306927a5323e02177804cba386d73bc81f3df3d02cae0946b34"}
Jul 09 19:11:20.919168 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:20.919106    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:11:21.043561 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043532    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-model-cache\") pod \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") "
Jul 09 19:11:21.043763 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043610    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2wkr\" (UniqueName: \"kubernetes.io/projected/833ed9c3-fd81-435b-ac03-c73bd75ef98b-kube-api-access-w2wkr\") pod \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") "
Jul 09 19:11:21.043763 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043647    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tmp-dir\") pod \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") "
Jul 09 19:11:21.043763 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043665    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-home\") pod \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") "
Jul 09 19:11:21.043763 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043684    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-dshm\") pod \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") "
Jul 09 19:11:21.043763 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043700    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tls-certs\") pod \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\" (UID: \"833ed9c3-fd81-435b-ac03-c73bd75ef98b\") "
Jul 09 19:11:21.044090 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043829    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-model-cache" (OuterVolumeSpecName: "model-cache") pod "833ed9c3-fd81-435b-ac03-c73bd75ef98b" (UID: "833ed9c3-fd81-435b-ac03-c73bd75ef98b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:21.044090 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043945    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "833ed9c3-fd81-435b-ac03-c73bd75ef98b" (UID: "833ed9c3-fd81-435b-ac03-c73bd75ef98b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:21.044090 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.043966    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-home" (OuterVolumeSpecName: "home") pod "833ed9c3-fd81-435b-ac03-c73bd75ef98b" (UID: "833ed9c3-fd81-435b-ac03-c73bd75ef98b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:21.044090 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.044006    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-model-cache\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:21.045889 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.045866    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "833ed9c3-fd81-435b-ac03-c73bd75ef98b" (UID: "833ed9c3-fd81-435b-ac03-c73bd75ef98b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:11:21.045966 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.045885    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833ed9c3-fd81-435b-ac03-c73bd75ef98b-kube-api-access-w2wkr" (OuterVolumeSpecName: "kube-api-access-w2wkr") pod "833ed9c3-fd81-435b-ac03-c73bd75ef98b" (UID: "833ed9c3-fd81-435b-ac03-c73bd75ef98b"). InnerVolumeSpecName "kube-api-access-w2wkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:11:21.045966 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.045883    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-dshm" (OuterVolumeSpecName: "dshm") pod "833ed9c3-fd81-435b-ac03-c73bd75ef98b" (UID: "833ed9c3-fd81-435b-ac03-c73bd75ef98b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:21.145244 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.145213    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2wkr\" (UniqueName: \"kubernetes.io/projected/833ed9c3-fd81-435b-ac03-c73bd75ef98b-kube-api-access-w2wkr\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:21.145244 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.145240    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tmp-dir\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:21.145244 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.145251    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-home\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:21.145472 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.145258    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/833ed9c3-fd81-435b-ac03-c73bd75ef98b-dshm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:21.145472 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.145266    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/833ed9c3-fd81-435b-ac03-c73bd75ef98b-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:11:21.903828 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.903792    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"
Jul 09 19:11:21.904297 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.903784    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk" event={"ID":"833ed9c3-fd81-435b-ac03-c73bd75ef98b","Type":"ContainerDied","Data":"a1aa60cd748c1d0e77da7ebb7767fe4a237d02f3d7b5d4ab3643894b2fde9422"}
Jul 09 19:11:21.904297 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.903949    2569 scope.go:117] "RemoveContainer" containerID="9520965f8db14306927a5323e02177804cba386d73bc81f3df3d02cae0946b34"
Jul 09 19:11:21.924300 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.924266    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"]
Jul 09 19:11:21.930627 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:21.930601    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-vgtfk"]
Jul 09 19:11:23.125008 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:11:23.124976    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="833ed9c3-fd81-435b-ac03-c73bd75ef98b" path="/var/lib/kubelet/pods/833ed9c3-fd81-435b-ac03-c73bd75ef98b/volumes"
Jul 09 19:12:22.675201 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.675165    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"]
Jul 09 19:12:22.675662 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.675560    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bfba8de-d83f-49a5-8cf4-298f604942e7" containerName="main"
Jul 09 19:12:22.675662 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.675571    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bfba8de-d83f-49a5-8cf4-298f604942e7" containerName="main"
Jul 09 19:12:22.675662 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.675586    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833ed9c3-fd81-435b-ac03-c73bd75ef98b" containerName="main"
Jul 09 19:12:22.675662 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.675591    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="833ed9c3-fd81-435b-ac03-c73bd75ef98b" containerName="main"
Jul 09 19:12:22.675662 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.675650    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bfba8de-d83f-49a5-8cf4-298f604942e7" containerName="main"
Jul 09 19:12:22.675662 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.675657    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="833ed9c3-fd81-435b-ac03-c73bd75ef98b" containerName="main"
Jul 09 19:12:22.678887 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.678867    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.682114 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.682091    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Jul 09 19:12:22.692924 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.692896    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"]
Jul 09 19:12:22.806441 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.806405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.806623 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.806451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.806623 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.806476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.806623 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.806554    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvnxq\" (UniqueName: \"kubernetes.io/projected/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-kube-api-access-xvnxq\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.806623 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.806590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.806771 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.806630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.907947 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.907913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.908173 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.907958    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.908173 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.908126    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvnxq\" (UniqueName: \"kubernetes.io/projected/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-kube-api-access-xvnxq\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.908314 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.908204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.908634 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.908589    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.909307 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.909284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.909637 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.909614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.910341 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.910305    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.910779 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.910710    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.910987 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.910967    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.911457 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.911413    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.914473 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.914449    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"]
Jul 09 19:12:22.918045 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.918029    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:22.921032 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.921012    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-z95d9\""
Jul 09 19:12:22.926042 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.925967    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvnxq\" (UniqueName: \"kubernetes.io/projected/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-kube-api-access-xvnxq\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:22.928043 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.928015    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"]
Jul 09 19:12:22.990204 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:22.990169    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:23.011491 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.011446    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6svq\" (UniqueName: \"kubernetes.io/projected/eb420409-a053-41f6-a1ca-9fbd38a22b5a-kube-api-access-g6svq\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.011659 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.011564    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.011659 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.011614    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.112478 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.112436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6svq\" (UniqueName: \"kubernetes.io/projected/eb420409-a053-41f6-a1ca-9fbd38a22b5a-kube-api-access-g6svq\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.112684 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.112495    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.112684 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.112522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.112999 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.112969    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.115276 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.115254    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.127009 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.126978    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6svq\" (UniqueName: \"kubernetes.io/projected/eb420409-a053-41f6-a1ca-9fbd38a22b5a-kube-api-access-g6svq\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.145338 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.145312    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"]
Jul 09 19:12:23.146808 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:12:23.146784    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8818f7e_4da9_4f5b_85be_e37c6bbb23c5.slice/crio-d1e3545b864e1c7b9ee92c63059deb9b3d600dc1a72d37e9ef3b642457be2af5 WatchSource:0}: Error finding container d1e3545b864e1c7b9ee92c63059deb9b3d600dc1a72d37e9ef3b642457be2af5: Status 404 returned error can't find the container with id d1e3545b864e1c7b9ee92c63059deb9b3d600dc1a72d37e9ef3b642457be2af5
Jul 09 19:12:23.246643 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.246609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:23.259000 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.258950    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t" event={"ID":"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5","Type":"ContainerStarted","Data":"6a55f2e4c9a0f430bfe69216db4ed5bd4dd7c07beb53efc3404df5857306685f"}
Jul 09 19:12:23.259210 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.259028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t" event={"ID":"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5","Type":"ContainerStarted","Data":"d1e3545b864e1c7b9ee92c63059deb9b3d600dc1a72d37e9ef3b642457be2af5"}
Jul 09 19:12:23.278306 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.278242    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t" podStartSLOduration=1.278212288 podStartE2EDuration="1.278212288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:12:23.278126907 +0000 UTC m=+4064.777183653" watchObservedRunningTime="2026-07-09 19:12:23.278212288 +0000 UTC m=+4064.777269028"
Jul 09 19:12:23.404903 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.404873    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"]
Jul 09 19:12:23.407669 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:12:23.407624    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb420409_a053_41f6_a1ca_9fbd38a22b5a.slice/crio-59829f4b89070357d3f9a376aa1cfc06ed2b591fb122a53fc08d36be03340e01 WatchSource:0}: Error finding container 59829f4b89070357d3f9a376aa1cfc06ed2b591fb122a53fc08d36be03340e01: Status 404 returned error can't find the container with id 59829f4b89070357d3f9a376aa1cfc06ed2b591fb122a53fc08d36be03340e01
Jul 09 19:12:23.990903 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:23.990870    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:24.266188 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:24.266091    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" event={"ID":"eb420409-a053-41f6-a1ca-9fbd38a22b5a","Type":"ContainerStarted","Data":"b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa"}
Jul 09 19:12:24.266188 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:24.266155    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" event={"ID":"eb420409-a053-41f6-a1ca-9fbd38a22b5a","Type":"ContainerStarted","Data":"59829f4b89070357d3f9a376aa1cfc06ed2b591fb122a53fc08d36be03340e01"}
Jul 09 19:12:24.266384 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:24.266230    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:12:24.284594 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:24.284539    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podStartSLOduration=2.284517807 podStartE2EDuration="2.284517807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:12:24.283831507 +0000 UTC m=+4065.782888258" watchObservedRunningTime="2026-07-09 19:12:24.284517807 +0000 UTC m=+4065.783574558"
Jul 09 19:12:32.990847 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:32.990810    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:33.003590 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:33.003558    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:33.328917 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:33.328888    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:12:55.273591 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:12:55.273552    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:13:05.274314 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:13:05.274269    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:13:15.273230 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:13:15.273191    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:13:25.273231 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:13:25.273187    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:13:30.117832 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:13:30.117794    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:13:40.118344 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:13:40.118298    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:13:50.119538 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:13:50.119485    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:14:00.118306 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:00.118268    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:14:00.741429 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:00.741392    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"]
Jul 09 19:14:00.743859 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:00.743793    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 19:14:00.750709 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:00.750675    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"]
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:14:00.755040    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:  > containerID="b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa" cmd=["/bin/sleep","15"]
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:00.755118    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" message="" err=<
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:  >
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:14:00.755135    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" containerID="cri-o://b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa"
Jul 09 19:14:00.755328 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:00.755193    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main" containerID="cri-o://b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa" gracePeriod=60
Jul 09 19:14:01.022792 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.022769    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:14:01.050907 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.050881    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tls-certs\") pod \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") "
Jul 09 19:14:01.051087 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.050970    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tokenizer-uds\") pod \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") "
Jul 09 19:14:01.051169 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.051087    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6svq\" (UniqueName: \"kubernetes.io/projected/eb420409-a053-41f6-a1ca-9fbd38a22b5a-kube-api-access-g6svq\") pod \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\" (UID: \"eb420409-a053-41f6-a1ca-9fbd38a22b5a\") "
Jul 09 19:14:01.051222 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.051206    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "eb420409-a053-41f6-a1ca-9fbd38a22b5a" (UID: "eb420409-a053-41f6-a1ca-9fbd38a22b5a"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:14:01.051386 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.051371    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tokenizer-uds\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:01.053124 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.053083    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb420409-a053-41f6-a1ca-9fbd38a22b5a-kube-api-access-g6svq" (OuterVolumeSpecName: "kube-api-access-g6svq") pod "eb420409-a053-41f6-a1ca-9fbd38a22b5a" (UID: "eb420409-a053-41f6-a1ca-9fbd38a22b5a"). InnerVolumeSpecName "kube-api-access-g6svq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:14:01.053124 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.053097    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb420409-a053-41f6-a1ca-9fbd38a22b5a" (UID: "eb420409-a053-41f6-a1ca-9fbd38a22b5a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:14:01.152721 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.152698    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6svq\" (UniqueName: \"kubernetes.io/projected/eb420409-a053-41f6-a1ca-9fbd38a22b5a-kube-api-access-g6svq\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:01.152721 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.152719    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb420409-a053-41f6-a1ca-9fbd38a22b5a-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:01.829759 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.829724    2569 generic.go:356] "Generic (PLEG): container finished" podID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerID="b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa" exitCode=0
Jul 09 19:14:01.829990 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.829777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" event={"ID":"eb420409-a053-41f6-a1ca-9fbd38a22b5a","Type":"ContainerDied","Data":"b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa"}
Jul 09 19:14:01.829990 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.829788    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"
Jul 09 19:14:01.829990 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.829825    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb" event={"ID":"eb420409-a053-41f6-a1ca-9fbd38a22b5a","Type":"ContainerDied","Data":"59829f4b89070357d3f9a376aa1cfc06ed2b591fb122a53fc08d36be03340e01"}
Jul 09 19:14:01.829990 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.829854    2569 scope.go:117] "RemoveContainer" containerID="b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa"
Jul 09 19:14:01.845633 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.845607    2569 scope.go:117] "RemoveContainer" containerID="b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa"
Jul 09 19:14:01.846015 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:14:01.845979    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa\": container with ID starting with b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa not found: ID does not exist" containerID="b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa"
Jul 09 19:14:01.846176 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.846018    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa"} err="failed to get container status \"b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa\": rpc error: code = NotFound desc = could not find container \"b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa\": container with ID starting with b88c093f0a985a739dc5d98c9b8a87037663bc8ed31cef5262767e4ce7b160aa not found: ID does not exist"
Jul 09 19:14:01.847851 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.847826    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"]
Jul 09 19:14:01.854507 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:01.854478    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85ddclsb"]
Jul 09 19:14:03.123341 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:03.123308    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" path="/var/lib/kubelet/pods/eb420409-a053-41f6-a1ca-9fbd38a22b5a/volumes"
Jul 09 19:14:15.783077 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:15.783010    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t" podUID="c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" containerName="main" containerID="cri-o://6a55f2e4c9a0f430bfe69216db4ed5bd4dd7c07beb53efc3404df5857306685f" gracePeriod=45
Jul 09 19:14:15.919602 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:15.919569    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" containerID="6a55f2e4c9a0f430bfe69216db4ed5bd4dd7c07beb53efc3404df5857306685f" exitCode=0
Jul 09 19:14:15.919767 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:15.919641    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t" event={"ID":"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5","Type":"ContainerDied","Data":"6a55f2e4c9a0f430bfe69216db4ed5bd4dd7c07beb53efc3404df5857306685f"}
Jul 09 19:14:16.061116 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.061089    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:14:16.192676 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.192570    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-dshm\") pod \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") "
Jul 09 19:14:16.192676 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.192673    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tls-certs\") pod \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") "
Jul 09 19:14:16.192930 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.192701    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-home\") pod \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") "
Jul 09 19:14:16.192930 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.192722    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvnxq\" (UniqueName: \"kubernetes.io/projected/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-kube-api-access-xvnxq\") pod \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") "
Jul 09 19:14:16.192930 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.192741    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-model-cache\") pod \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") "
Jul 09 19:14:16.192930 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.192764    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tmp-dir\") pod \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\" (UID: \"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5\") "
Jul 09 19:14:16.193156 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.192947    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-home" (OuterVolumeSpecName: "home") pod "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" (UID: "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:14:16.193156 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.193018    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" (UID: "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:14:16.193156 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.193128    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-home\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:16.193156 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.193131    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" (UID: "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:14:16.194792 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.194765    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" (UID: "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:14:16.194915 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.194789    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-dshm" (OuterVolumeSpecName: "dshm") pod "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" (UID: "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:14:16.194915 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.194807    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-kube-api-access-xvnxq" (OuterVolumeSpecName: "kube-api-access-xvnxq") pod "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" (UID: "c8818f7e-4da9-4f5b-85be-e37c6bbb23c5"). InnerVolumeSpecName "kube-api-access-xvnxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:14:16.294187 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.294154    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:16.294187 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.294181    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvnxq\" (UniqueName: \"kubernetes.io/projected/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-kube-api-access-xvnxq\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:16.294187 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.294193    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-model-cache\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:16.294428 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.294201    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-tmp-dir\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:16.294428 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.294209    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5-dshm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:14:16.926579 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.926548    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"
Jul 09 19:14:16.926579 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.926565    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t" event={"ID":"c8818f7e-4da9-4f5b-85be-e37c6bbb23c5","Type":"ContainerDied","Data":"d1e3545b864e1c7b9ee92c63059deb9b3d600dc1a72d37e9ef3b642457be2af5"}
Jul 09 19:14:16.927181 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.926657    2569 scope.go:117] "RemoveContainer" containerID="6a55f2e4c9a0f430bfe69216db4ed5bd4dd7c07beb53efc3404df5857306685f"
Jul 09 19:14:16.949886 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.949853    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"]
Jul 09 19:14:16.953661 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:16.953639    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-j694t"]
Jul 09 19:14:17.123919 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:17.123889    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" path="/var/lib/kubelet/pods/c8818f7e-4da9-4f5b-85be-e37c6bbb23c5/volumes"
Jul 09 19:14:39.441419 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:39.441299    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:14:39.460863 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:14:39.460842    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:15:01.582125 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.582011    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"]
Jul 09 19:15:01.582621 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.582601    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" containerName="main"
Jul 09 19:15:01.582715 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.582624    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" containerName="main"
Jul 09 19:15:01.582715 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.582639    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main"
Jul 09 19:15:01.582715 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.582647    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main"
Jul 09 19:15:01.582862 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.582749    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb420409-a053-41f6-a1ca-9fbd38a22b5a" containerName="main"
Jul 09 19:15:01.582862 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.582770    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8818f7e-4da9-4f5b-85be-e37c6bbb23c5" containerName="main"
Jul 09 19:15:01.585890 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.585869    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.588975 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.588953    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-kserve-self-signed-certs\""
Jul 09 19:15:01.597075 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.597038    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"]
Jul 09 19:15:01.727140 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.727109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.727296 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.727192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxss\" (UniqueName: \"kubernetes.io/projected/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-kube-api-access-wtxss\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.727296 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.727226    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.727296 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.727260    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.727296 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.727278    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.727435 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.727326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828298 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828263    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxss\" (UniqueName: \"kubernetes.io/projected/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-kube-api-access-wtxss\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828378    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828818 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828795    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828870 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828849    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.828911 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.828868    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.830768 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.830750    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.830924 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.830906    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.837328 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.837272    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxss\" (UniqueName: \"kubernetes.io/projected/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-kube-api-access-wtxss\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:01.896620 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:01.896580    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:02.062772 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:02.062742    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"]
Jul 09 19:15:02.065118 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:15:02.065085    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a6bce9_fd6a_4168_8d26_b232b3ed5a53.slice/crio-3fea21c3e982a56af5486eeaa290815cb923eb2ce8640e4d49c8ba713e47d458 WatchSource:0}: Error finding container 3fea21c3e982a56af5486eeaa290815cb923eb2ce8640e4d49c8ba713e47d458: Status 404 returned error can't find the container with id 3fea21c3e982a56af5486eeaa290815cb923eb2ce8640e4d49c8ba713e47d458
Jul 09 19:15:02.211989 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:02.211946    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp" event={"ID":"85a6bce9-fd6a-4168-8d26-b232b3ed5a53","Type":"ContainerStarted","Data":"31fa66997e238e0e987f99899bb42a40a28f3d05d0334287953a81d92c67100a"}
Jul 09 19:15:02.212218 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:02.212013    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp" event={"ID":"85a6bce9-fd6a-4168-8d26-b232b3ed5a53","Type":"ContainerStarted","Data":"3fea21c3e982a56af5486eeaa290815cb923eb2ce8640e4d49c8ba713e47d458"}
Jul 09 19:15:02.234611 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:02.234559    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp" podStartSLOduration=1.234542433 podStartE2EDuration="1.234542433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:15:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:15:02.232852624 +0000 UTC m=+4223.731909406" watchObservedRunningTime="2026-07-09 19:15:02.234542433 +0000 UTC m=+4223.733599180"
Jul 09 19:15:02.896853 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:02.896823    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:11.897080 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:11.897019    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:11.910450 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:11.910424    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:15:12.280233 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:15:12.280147    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:16:05.411460 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:05.411422    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"]
Jul 09 19:16:20.432543 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.432503    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp" podUID="85a6bce9-fd6a-4168-8d26-b232b3ed5a53" containerName="main" containerID="cri-o://31fa66997e238e0e987f99899bb42a40a28f3d05d0334287953a81d92c67100a" gracePeriod=45
Jul 09 19:16:20.675722 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.675693    2569 generic.go:356] "Generic (PLEG): container finished" podID="85a6bce9-fd6a-4168-8d26-b232b3ed5a53" containerID="31fa66997e238e0e987f99899bb42a40a28f3d05d0334287953a81d92c67100a" exitCode=0
Jul 09 19:16:20.675847 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.675767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp" event={"ID":"85a6bce9-fd6a-4168-8d26-b232b3ed5a53","Type":"ContainerDied","Data":"31fa66997e238e0e987f99899bb42a40a28f3d05d0334287953a81d92c67100a"}
Jul 09 19:16:20.692744 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.692682    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:16:20.760678 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.760644    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-dshm\") pod \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") "
Jul 09 19:16:20.760864 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.760706    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-home\") pod \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") "
Jul 09 19:16:20.760864 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.760736    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtxss\" (UniqueName: \"kubernetes.io/projected/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-kube-api-access-wtxss\") pod \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") "
Jul 09 19:16:20.760864 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.760776    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tls-certs\") pod \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") "
Jul 09 19:16:20.760864 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.760800    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tmp-dir\") pod \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") "
Jul 09 19:16:20.761115 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.760902    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-model-cache\") pod \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\" (UID: \"85a6bce9-fd6a-4168-8d26-b232b3ed5a53\") "
Jul 09 19:16:20.761115 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.760972    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-home" (OuterVolumeSpecName: "home") pod "85a6bce9-fd6a-4168-8d26-b232b3ed5a53" (UID: "85a6bce9-fd6a-4168-8d26-b232b3ed5a53"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:16:20.761115 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.761078    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85a6bce9-fd6a-4168-8d26-b232b3ed5a53" (UID: "85a6bce9-fd6a-4168-8d26-b232b3ed5a53"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:16:20.761283 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.761146    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-model-cache" (OuterVolumeSpecName: "model-cache") pod "85a6bce9-fd6a-4168-8d26-b232b3ed5a53" (UID: "85a6bce9-fd6a-4168-8d26-b232b3ed5a53"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:16:20.761344 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.761292    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-home\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:16:20.761344 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.761307    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tmp-dir\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:16:20.761344 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.761320    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-model-cache\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:16:20.762837 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.762809    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-dshm" (OuterVolumeSpecName: "dshm") pod "85a6bce9-fd6a-4168-8d26-b232b3ed5a53" (UID: "85a6bce9-fd6a-4168-8d26-b232b3ed5a53"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:16:20.762972 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.762944    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-kube-api-access-wtxss" (OuterVolumeSpecName: "kube-api-access-wtxss") pod "85a6bce9-fd6a-4168-8d26-b232b3ed5a53" (UID: "85a6bce9-fd6a-4168-8d26-b232b3ed5a53"). InnerVolumeSpecName "kube-api-access-wtxss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:16:20.763042 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.762964    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85a6bce9-fd6a-4168-8d26-b232b3ed5a53" (UID: "85a6bce9-fd6a-4168-8d26-b232b3ed5a53"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:16:20.862006 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.861969    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-dshm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:16:20.862006 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.862002    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtxss\" (UniqueName: \"kubernetes.io/projected/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-kube-api-access-wtxss\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:16:20.862006 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:20.862015    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85a6bce9-fd6a-4168-8d26-b232b3ed5a53-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:16:21.682471 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:21.682439    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"
Jul 09 19:16:21.682909 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:21.682481    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp" event={"ID":"85a6bce9-fd6a-4168-8d26-b232b3ed5a53","Type":"ContainerDied","Data":"3fea21c3e982a56af5486eeaa290815cb923eb2ce8640e4d49c8ba713e47d458"}
Jul 09 19:16:21.682909 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:21.682545    2569 scope.go:117] "RemoveContainer" containerID="31fa66997e238e0e987f99899bb42a40a28f3d05d0334287953a81d92c67100a"
Jul 09 19:16:21.700945 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:21.700916    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"]
Jul 09 19:16:21.705537 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:21.705505    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-m9rcp"]
Jul 09 19:16:23.129351 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:16:23.129321    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85a6bce9-fd6a-4168-8d26-b232b3ed5a53" path="/var/lib/kubelet/pods/85a6bce9-fd6a-4168-8d26-b232b3ed5a53/volumes"
Jul 09 19:17:03.843369 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.843335    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"]
Jul 09 19:17:03.843776 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.843708    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a6bce9-fd6a-4168-8d26-b232b3ed5a53" containerName="main"
Jul 09 19:17:03.843776 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.843718    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a6bce9-fd6a-4168-8d26-b232b3ed5a53" containerName="main"
Jul 09 19:17:03.843847 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.843792    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="85a6bce9-fd6a-4168-8d26-b232b3ed5a53" containerName="main"
Jul 09 19:17:03.846812 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.846796    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:03.849562 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.849543    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Jul 09 19:17:03.863139 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.863112    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"]
Jul 09 19:17:03.953086 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.953026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:03.953281 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.953121    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:03.953281 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.953162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:03.953281 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.953181    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:03.953281 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.953212    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n56m5\" (UniqueName: \"kubernetes.io/projected/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-kube-api-access-n56m5\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:03.953448 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:03.953310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.054631 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.054595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.054631 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.054633    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.054871 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.054648    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.054871 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.054681    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n56m5\" (UniqueName: \"kubernetes.io/projected/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-kube-api-access-n56m5\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.054871 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.054734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.054871 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.054838    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.055119 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.055100    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.055197 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.055173    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.055255 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.055215    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.056984 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.056956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.057242 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.057225    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.064017 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.063995    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n56m5\" (UniqueName: \"kubernetes.io/projected/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-kube-api-access-n56m5\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.157650 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.157555    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:04.311965 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.311931    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"]
Jul 09 19:17:04.313051 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:17:04.313025    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ef535e_3fb0_4e1b_bbcf_f0b2fafb309a.slice/crio-492cd8fd2b2893f65178354426c2365b38d1675eb1e4e3cc1b85b6ab9c4d7446 WatchSource:0}: Error finding container 492cd8fd2b2893f65178354426c2365b38d1675eb1e4e3cc1b85b6ab9c4d7446: Status 404 returned error can't find the container with id 492cd8fd2b2893f65178354426c2365b38d1675eb1e4e3cc1b85b6ab9c4d7446
Jul 09 19:17:04.926199 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.926158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw" event={"ID":"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a","Type":"ContainerStarted","Data":"bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97"}
Jul 09 19:17:04.926668 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.926220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw" event={"ID":"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a","Type":"ContainerStarted","Data":"492cd8fd2b2893f65178354426c2365b38d1675eb1e4e3cc1b85b6ab9c4d7446"}
Jul 09 19:17:04.948031 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:04.947976    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw" podStartSLOduration=1.947961265 podStartE2EDuration="1.947961265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:17:04.945861314 +0000 UTC m=+4346.444918108" watchObservedRunningTime="2026-07-09 19:17:04.947961265 +0000 UTC m=+4346.447018012"
Jul 09 19:17:05.158108 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:05.158050    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:14.158444 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:14.158409    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:14.171149 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:14.171117    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:17:14.998039 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:17:14.998009    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:18:41.137928 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:41.137896    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"]
Jul 09 19:18:56.163297 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.163250    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw" podUID="c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" containerName="main" containerID="cri-o://bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97" gracePeriod=45
Jul 09 19:18:56.436177 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.436143    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:18:56.492311 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492279    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-model-cache\") pod \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") "
Jul 09 19:18:56.492482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492335    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n56m5\" (UniqueName: \"kubernetes.io/projected/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-kube-api-access-n56m5\") pod \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") "
Jul 09 19:18:56.492482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492358    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-dshm\") pod \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") "
Jul 09 19:18:56.492482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492378    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-home\") pod \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") "
Jul 09 19:18:56.492482 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492472    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tmp-dir\") pod \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") "
Jul 09 19:18:56.492700 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492507    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tls-certs\") pod \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\" (UID: \"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a\") "
Jul 09 19:18:56.492700 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492526    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" (UID: "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:56.492808 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492738    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" (UID: "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:56.492808 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492759    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-home" (OuterVolumeSpecName: "home") pod "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" (UID: "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:56.492808 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.492800    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-model-cache\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:18:56.494574 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.494549    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-dshm" (OuterVolumeSpecName: "dshm") pod "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" (UID: "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:56.494693 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.494574    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" (UID: "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:18:56.494693 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.494593    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-kube-api-access-n56m5" (OuterVolumeSpecName: "kube-api-access-n56m5") pod "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" (UID: "c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a"). InnerVolumeSpecName "kube-api-access-n56m5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:18:56.563033 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.563002    2569 generic.go:356] "Generic (PLEG): container finished" podID="c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" containerID="bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97" exitCode=0
Jul 09 19:18:56.563250 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.563042    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"
Jul 09 19:18:56.563250 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.563087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw" event={"ID":"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a","Type":"ContainerDied","Data":"bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97"}
Jul 09 19:18:56.563250 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.563137    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw" event={"ID":"c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a","Type":"ContainerDied","Data":"492cd8fd2b2893f65178354426c2365b38d1675eb1e4e3cc1b85b6ab9c4d7446"}
Jul 09 19:18:56.563250 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.563160    2569 scope.go:117] "RemoveContainer" containerID="bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97"
Jul 09 19:18:56.573337 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.573319    2569 scope.go:117] "RemoveContainer" containerID="bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97"
Jul 09 19:18:56.573612 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:18:56.573586    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97\": container with ID starting with bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97 not found: ID does not exist" containerID="bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97"
Jul 09 19:18:56.573667 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.573613    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97"} err="failed to get container status \"bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97\": rpc error: code = NotFound desc = could not find container \"bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97\": container with ID starting with bb2d42819643325c3565664d5d28b92de2a5d0b41d810f0b4607be4eac975c97 not found: ID does not exist"
Jul 09 19:18:56.586404 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.586371    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"]
Jul 09 19:18:56.588791 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.588770    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hj6kw"]
Jul 09 19:18:56.593971 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.593951    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-dshm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:18:56.593971 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.593970    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-home\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:18:56.594156 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.593978    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tmp-dir\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:18:56.594156 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.593986    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:18:56.594156 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:56.593994    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n56m5\" (UniqueName: \"kubernetes.io/projected/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a-kube-api-access-n56m5\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:18:57.134196 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:18:57.134163    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" path="/var/lib/kubelet/pods/c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a/volumes"
Jul 09 19:19:33.486861 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.486769    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"]
Jul 09 19:19:33.487437 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.487410    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" containerName="main"
Jul 09 19:19:33.487437 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.487437    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" containerName="main"
Jul 09 19:19:33.487634 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.487541    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ef535e-3fb0-4e1b-bbcf-f0b2fafb309a" containerName="main"
Jul 09 19:19:33.491125 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.491107    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.493927 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.493900    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Jul 09 19:19:33.494041 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.493930    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-dockercfg-kdpbm\""
Jul 09 19:19:33.505517 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.505495    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"]
Jul 09 19:19:33.608080 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.606614    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.608080 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.606673    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5hm\" (UniqueName: \"kubernetes.io/projected/200ea31c-7ee1-449d-8036-56c102507f29-kube-api-access-7j5hm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.608080 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.606719    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.608080 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.606748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/200ea31c-7ee1-449d-8036-56c102507f29-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.608080 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.606805    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.608080 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.606830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.708276 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.708243    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.708457 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.708291    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5hm\" (UniqueName: \"kubernetes.io/projected/200ea31c-7ee1-449d-8036-56c102507f29-kube-api-access-7j5hm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.708543 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.708467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.708543 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.708512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/200ea31c-7ee1-449d-8036-56c102507f29-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.708652 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.708590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.708652 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.708620    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.708797 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.708774    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.708911 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.708887    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.709048 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.709025    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.710869 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.710837    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.711123 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.711107    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/200ea31c-7ee1-449d-8036-56c102507f29-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.719625 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.719605    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5hm\" (UniqueName: \"kubernetes.io/projected/200ea31c-7ee1-449d-8036-56c102507f29-kube-api-access-7j5hm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.803735 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.803670    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:33.968317 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.968289    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"]
Jul 09 19:19:33.968669 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:19:33.968645    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200ea31c_7ee1_449d_8036_56c102507f29.slice/crio-5871598d8754139cfe43a03d87b884b96c223519c03cdd6aeef2229ff7f01aaf WatchSource:0}: Error finding container 5871598d8754139cfe43a03d87b884b96c223519c03cdd6aeef2229ff7f01aaf: Status 404 returned error can't find the container with id 5871598d8754139cfe43a03d87b884b96c223519c03cdd6aeef2229ff7f01aaf
Jul 09 19:19:33.970700 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:33.970685    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:19:34.791132 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:34.791104    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" event={"ID":"200ea31c-7ee1-449d-8036-56c102507f29","Type":"ContainerStarted","Data":"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2"}
Jul 09 19:19:34.791446 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:34.791165    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" event={"ID":"200ea31c-7ee1-449d-8036-56c102507f29","Type":"ContainerStarted","Data":"5871598d8754139cfe43a03d87b884b96c223519c03cdd6aeef2229ff7f01aaf"}
Jul 09 19:19:34.791446 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:34.791195    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:35.798439 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:35.798402    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" event={"ID":"200ea31c-7ee1-449d-8036-56c102507f29","Type":"ContainerStarted","Data":"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b"}
Jul 09 19:19:35.804623 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:35.804605    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:35.821229 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:35.821182    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" podStartSLOduration=2.091384118 podStartE2EDuration="2.821168558s" totalImagesPullingTime="729.78444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:19:35.818735118 +0000 UTC m=+4497.317791881" watchObservedRunningTime="2026-07-09 19:19:35.821168558 +0000 UTC m=+4497.320225355"
Jul 09 19:19:39.478220 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:39.478125    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:19:39.497102 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:39.497082    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:19:43.804607 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:43.804576    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:43.817557 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:43.817530    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:43.862825 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:43.862793    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:19:44.866419 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:19:44.866391    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:21:03.312302 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:03.312220    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"]
Jul 09 19:21:18.333189 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.333133    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" podUID="200ea31c-7ee1-449d-8036-56c102507f29" containerName="main" containerID="cri-o://27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b" gracePeriod=45
Jul 09 19:21:18.445180 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.445131    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" podUID="200ea31c-7ee1-449d-8036-56c102507f29" containerName="llm-d-routing-sidecar" containerID="cri-o://f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2" gracePeriod=45
Jul 09 19:21:18.693028 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.692998    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:21:18.721630 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.721606    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-dshm\") pod \"200ea31c-7ee1-449d-8036-56c102507f29\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") "
Jul 09 19:21:18.721758 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.721656    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-home\") pod \"200ea31c-7ee1-449d-8036-56c102507f29\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") "
Jul 09 19:21:18.721758 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.721677    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-model-cache\") pod \"200ea31c-7ee1-449d-8036-56c102507f29\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") "
Jul 09 19:21:18.721758 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.721696    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j5hm\" (UniqueName: \"kubernetes.io/projected/200ea31c-7ee1-449d-8036-56c102507f29-kube-api-access-7j5hm\") pod \"200ea31c-7ee1-449d-8036-56c102507f29\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") "
Jul 09 19:21:18.721758 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.721736    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/200ea31c-7ee1-449d-8036-56c102507f29-tls-certs\") pod \"200ea31c-7ee1-449d-8036-56c102507f29\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") "
Jul 09 19:21:18.721952 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.721770    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-tmp-dir\") pod \"200ea31c-7ee1-449d-8036-56c102507f29\" (UID: \"200ea31c-7ee1-449d-8036-56c102507f29\") "
Jul 09 19:21:18.721952 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.721905    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-home" (OuterVolumeSpecName: "home") pod "200ea31c-7ee1-449d-8036-56c102507f29" (UID: "200ea31c-7ee1-449d-8036-56c102507f29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:18.721952 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.721934    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-model-cache" (OuterVolumeSpecName: "model-cache") pod "200ea31c-7ee1-449d-8036-56c102507f29" (UID: "200ea31c-7ee1-449d-8036-56c102507f29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:18.722118 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.722092    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-home\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:21:18.722192 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.722124    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-model-cache\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:21:18.722192 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.722138    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "200ea31c-7ee1-449d-8036-56c102507f29" (UID: "200ea31c-7ee1-449d-8036-56c102507f29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:18.723670 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.723647    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-dshm" (OuterVolumeSpecName: "dshm") pod "200ea31c-7ee1-449d-8036-56c102507f29" (UID: "200ea31c-7ee1-449d-8036-56c102507f29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:18.723820 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.723798    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200ea31c-7ee1-449d-8036-56c102507f29-kube-api-access-7j5hm" (OuterVolumeSpecName: "kube-api-access-7j5hm") pod "200ea31c-7ee1-449d-8036-56c102507f29" (UID: "200ea31c-7ee1-449d-8036-56c102507f29"). InnerVolumeSpecName "kube-api-access-7j5hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:21:18.723820 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.723809    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200ea31c-7ee1-449d-8036-56c102507f29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "200ea31c-7ee1-449d-8036-56c102507f29" (UID: "200ea31c-7ee1-449d-8036-56c102507f29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:21:18.822731 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.822704    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/200ea31c-7ee1-449d-8036-56c102507f29-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:21:18.822850 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.822743    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-tmp-dir\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:21:18.822850 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.822752    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/200ea31c-7ee1-449d-8036-56c102507f29-dshm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:21:18.822850 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:18.822761    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j5hm\" (UniqueName: \"kubernetes.io/projected/200ea31c-7ee1-449d-8036-56c102507f29-kube-api-access-7j5hm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:21:19.388312 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.388233    2569 generic.go:356] "Generic (PLEG): container finished" podID="200ea31c-7ee1-449d-8036-56c102507f29" containerID="27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b" exitCode=0
Jul 09 19:21:19.388312 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.388262    2569 generic.go:356] "Generic (PLEG): container finished" podID="200ea31c-7ee1-449d-8036-56c102507f29" containerID="f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2" exitCode=0
Jul 09 19:21:19.388312 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.388284    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"
Jul 09 19:21:19.388778 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.388319    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" event={"ID":"200ea31c-7ee1-449d-8036-56c102507f29","Type":"ContainerDied","Data":"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b"}
Jul 09 19:21:19.388778 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.388378    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" event={"ID":"200ea31c-7ee1-449d-8036-56c102507f29","Type":"ContainerDied","Data":"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2"}
Jul 09 19:21:19.388778 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.388406    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh" event={"ID":"200ea31c-7ee1-449d-8036-56c102507f29","Type":"ContainerDied","Data":"5871598d8754139cfe43a03d87b884b96c223519c03cdd6aeef2229ff7f01aaf"}
Jul 09 19:21:19.388778 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.388432    2569 scope.go:117] "RemoveContainer" containerID="27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b"
Jul 09 19:21:19.397491 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.397472    2569 scope.go:117] "RemoveContainer" containerID="f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2"
Jul 09 19:21:19.406001 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.405976    2569 scope.go:117] "RemoveContainer" containerID="27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b"
Jul 09 19:21:19.406300 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:21:19.406282    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b\": container with ID starting with 27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b not found: ID does not exist" containerID="27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b"
Jul 09 19:21:19.406379 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.406309    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b"} err="failed to get container status \"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b\": rpc error: code = NotFound desc = could not find container \"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b\": container with ID starting with 27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b not found: ID does not exist"
Jul 09 19:21:19.406379 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.406326    2569 scope.go:117] "RemoveContainer" containerID="f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2"
Jul 09 19:21:19.406569 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:21:19.406553    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2\": container with ID starting with f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2 not found: ID does not exist" containerID="f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2"
Jul 09 19:21:19.406625 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.406572    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2"} err="failed to get container status \"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2\": rpc error: code = NotFound desc = could not find container \"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2\": container with ID starting with f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2 not found: ID does not exist"
Jul 09 19:21:19.406625 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.406585    2569 scope.go:117] "RemoveContainer" containerID="27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b"
Jul 09 19:21:19.406817 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.406791    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b"} err="failed to get container status \"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b\": rpc error: code = NotFound desc = could not find container \"27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b\": container with ID starting with 27a0496f343298ad999d6ca02c471c0021469990b1649b3bdeb627877fa0176b not found: ID does not exist"
Jul 09 19:21:19.406920 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.406818    2569 scope.go:117] "RemoveContainer" containerID="f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2"
Jul 09 19:21:19.407119 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.407101    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2"} err="failed to get container status \"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2\": rpc error: code = NotFound desc = could not find container \"f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2\": container with ID starting with f8e50f05b66ede10cc22ee80f9062e75ad21b5baf67b37b186460015729889a2 not found: ID does not exist"
Jul 09 19:21:19.408277 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.408258    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"]
Jul 09 19:21:19.412262 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:19.412244    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kcqvh"]
Jul 09 19:21:21.122372 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:21.122343    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200ea31c-7ee1-449d-8036-56c102507f29" path="/var/lib/kubelet/pods/200ea31c-7ee1-449d-8036-56c102507f29/volumes"
Jul 09 19:21:53.737503 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.737466    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"]
Jul 09 19:21:53.737901 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.737860    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200ea31c-7ee1-449d-8036-56c102507f29" containerName="llm-d-routing-sidecar"
Jul 09 19:21:53.737901 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.737872    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="200ea31c-7ee1-449d-8036-56c102507f29" containerName="llm-d-routing-sidecar"
Jul 09 19:21:53.737901 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.737883    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200ea31c-7ee1-449d-8036-56c102507f29" containerName="main"
Jul 09 19:21:53.737901 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.737888    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="200ea31c-7ee1-449d-8036-56c102507f29" containerName="main"
Jul 09 19:21:53.738033 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.737947    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="200ea31c-7ee1-449d-8036-56c102507f29" containerName="main"
Jul 09 19:21:53.738033 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.737956    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="200ea31c-7ee1-449d-8036-56c102507f29" containerName="llm-d-routing-sidecar"
Jul 09 19:21:53.742390 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.742373    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.746895 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.746872    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Jul 09 19:21:53.755069 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.755036    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"]
Jul 09 19:21:53.811112 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.811071    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-home\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.811268 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.811129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-dshm\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.811268 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.811168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-model-cache\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.811268 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.811201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tmp-dir\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.811403 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.811280    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tls-certs\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.811403 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.811351    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxkh\" (UniqueName: \"kubernetes.io/projected/ef2ded43-b4dc-46b2-9388-47a076bfe6da-kube-api-access-9hxkh\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.911914 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.911885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxkh\" (UniqueName: \"kubernetes.io/projected/ef2ded43-b4dc-46b2-9388-47a076bfe6da-kube-api-access-9hxkh\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.912123 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.911958    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-home\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.912123 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.911975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-dshm\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.912123 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.911996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-model-cache\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.912123 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.912013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tmp-dir\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.912339 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.912162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tls-certs\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.912339 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.912334    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-home\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.912427 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.912407    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-model-cache\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.912550 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.912528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tmp-dir\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.914395 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.914366    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-dshm\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.914583 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.914567    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tls-certs\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.924371 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.924350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxkh\" (UniqueName: \"kubernetes.io/projected/ef2ded43-b4dc-46b2-9388-47a076bfe6da-kube-api-access-9hxkh\") pod \"rolling-upgrade-test-kserve-54bc76f55b-4dj2c\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:53.985875 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.985840    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"]
Jul 09 19:21:53.990433 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.990362    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:53.993598 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:53.993572    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"rolling-upgrade-test-epp-sa-dockercfg-s45hv\""
Jul 09 19:21:54.001845 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.001820    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"]
Jul 09 19:21:54.053008 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.052972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:21:54.114305 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.114267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f86a496f-bef3-4b64-b239-7e154b84eb7f-tokenizer-uds\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.114469 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.114322    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86a496f-bef3-4b64-b239-7e154b84eb7f-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.114469 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.114426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fh7z\" (UniqueName: \"kubernetes.io/projected/f86a496f-bef3-4b64-b239-7e154b84eb7f-kube-api-access-2fh7z\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.202621 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.202588    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"]
Jul 09 19:21:54.202736 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:21:54.202639    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2ded43_b4dc_46b2_9388_47a076bfe6da.slice/crio-d5a44b26fca24c94c5502c90b7c1498b243c16af3eab609a8161476173274bb9 WatchSource:0}: Error finding container d5a44b26fca24c94c5502c90b7c1498b243c16af3eab609a8161476173274bb9: Status 404 returned error can't find the container with id d5a44b26fca24c94c5502c90b7c1498b243c16af3eab609a8161476173274bb9
Jul 09 19:21:54.215961 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.215924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f86a496f-bef3-4b64-b239-7e154b84eb7f-tokenizer-uds\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.216088 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.215986    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86a496f-bef3-4b64-b239-7e154b84eb7f-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.216088 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.216031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fh7z\" (UniqueName: \"kubernetes.io/projected/f86a496f-bef3-4b64-b239-7e154b84eb7f-kube-api-access-2fh7z\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.216304 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.216283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f86a496f-bef3-4b64-b239-7e154b84eb7f-tokenizer-uds\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.218509 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.218487    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86a496f-bef3-4b64-b239-7e154b84eb7f-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.225693 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.225669    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fh7z\" (UniqueName: \"kubernetes.io/projected/f86a496f-bef3-4b64-b239-7e154b84eb7f-kube-api-access-2fh7z\") pod \"rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.302916 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.302882    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.456771 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.456745    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"]
Jul 09 19:21:54.458483 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:21:54.458457    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf86a496f_bef3_4b64_b239_7e154b84eb7f.slice/crio-a6313ae6ecad2ab6e42b2cef498b289568271fa53b172332a2a1071db9502614 WatchSource:0}: Error finding container a6313ae6ecad2ab6e42b2cef498b289568271fa53b172332a2a1071db9502614: Status 404 returned error can't find the container with id a6313ae6ecad2ab6e42b2cef498b289568271fa53b172332a2a1071db9502614
Jul 09 19:21:54.581001 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.580963    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6" event={"ID":"f86a496f-bef3-4b64-b239-7e154b84eb7f","Type":"ContainerStarted","Data":"5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb"}
Jul 09 19:21:54.581210 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.581160    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:21:54.581210 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.581203    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6" event={"ID":"f86a496f-bef3-4b64-b239-7e154b84eb7f","Type":"ContainerStarted","Data":"a6313ae6ecad2ab6e42b2cef498b289568271fa53b172332a2a1071db9502614"}
Jul 09 19:21:54.582833 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.582804    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c" event={"ID":"ef2ded43-b4dc-46b2-9388-47a076bfe6da","Type":"ContainerStarted","Data":"a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4"}
Jul 09 19:21:54.582935 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.582849    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c" event={"ID":"ef2ded43-b4dc-46b2-9388-47a076bfe6da","Type":"ContainerStarted","Data":"d5a44b26fca24c94c5502c90b7c1498b243c16af3eab609a8161476173274bb9"}
Jul 09 19:21:54.600677 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.600607    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6" podStartSLOduration=1.600593315 podStartE2EDuration="1.600593315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:21:54.599176298 +0000 UTC m=+4636.098233046" watchObservedRunningTime="2026-07-09 19:21:54.600593315 +0000 UTC m=+4636.099650061"
Jul 09 19:21:54.620821 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:54.620766    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c" podStartSLOduration=1.620746988 podStartE2EDuration="1.620746988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:21:54.618507131 +0000 UTC m=+4636.117563882" watchObservedRunningTime="2026-07-09 19:21:54.620746988 +0000 UTC m=+4636.119803738"
Jul 09 19:21:55.053775 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:21:55.053738    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:22:04.053872 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:22:04.053836    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:22:04.066697 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:22:04.066676    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:22:04.657464 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:22:04.657432    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:22:25.590369 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:22:25.590340    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:23:07.690294 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:07.690259    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"]
Jul 09 19:23:22.721727 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:22.721683    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c" podUID="ef2ded43-b4dc-46b2-9388-47a076bfe6da" containerName="main" containerID="cri-o://a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4" gracePeriod=45
Jul 09 19:23:22.977517 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:22.977457    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:23:23.078319 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.078281    2569 generic.go:356] "Generic (PLEG): container finished" podID="ef2ded43-b4dc-46b2-9388-47a076bfe6da" containerID="a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4" exitCode=0
Jul 09 19:23:23.078495 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.078334    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"
Jul 09 19:23:23.078495 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.078356    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c" event={"ID":"ef2ded43-b4dc-46b2-9388-47a076bfe6da","Type":"ContainerDied","Data":"a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4"}
Jul 09 19:23:23.078495 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.078410    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c" event={"ID":"ef2ded43-b4dc-46b2-9388-47a076bfe6da","Type":"ContainerDied","Data":"d5a44b26fca24c94c5502c90b7c1498b243c16af3eab609a8161476173274bb9"}
Jul 09 19:23:23.078495 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.078441    2569 scope.go:117] "RemoveContainer" containerID="a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4"
Jul 09 19:23:23.087625 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.087607    2569 scope.go:117] "RemoveContainer" containerID="a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4"
Jul 09 19:23:23.087864 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:23:23.087846    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4\": container with ID starting with a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4 not found: ID does not exist" containerID="a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4"
Jul 09 19:23:23.087923 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.087871    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4"} err="failed to get container status \"a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4\": rpc error: code = NotFound desc = could not find container \"a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4\": container with ID starting with a51137ce1001b5581967cda5a307421599ba9d78bf45f6e749e19eb73d7160d4 not found: ID does not exist"
Jul 09 19:23:23.100159 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100142    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hxkh\" (UniqueName: \"kubernetes.io/projected/ef2ded43-b4dc-46b2-9388-47a076bfe6da-kube-api-access-9hxkh\") pod \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") "
Jul 09 19:23:23.100244 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100203    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-home\") pod \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") "
Jul 09 19:23:23.100244 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100224    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-model-cache\") pod \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") "
Jul 09 19:23:23.100352 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100278    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-dshm\") pod \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") "
Jul 09 19:23:23.100352 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100294    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tmp-dir\") pod \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") "
Jul 09 19:23:23.100352 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100329    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tls-certs\") pod \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\" (UID: \"ef2ded43-b4dc-46b2-9388-47a076bfe6da\") "
Jul 09 19:23:23.100525 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100501    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef2ded43-b4dc-46b2-9388-47a076bfe6da" (UID: "ef2ded43-b4dc-46b2-9388-47a076bfe6da"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:23.100581 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100515    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-home" (OuterVolumeSpecName: "home") pod "ef2ded43-b4dc-46b2-9388-47a076bfe6da" (UID: "ef2ded43-b4dc-46b2-9388-47a076bfe6da"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:23.100581 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.100539    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef2ded43-b4dc-46b2-9388-47a076bfe6da" (UID: "ef2ded43-b4dc-46b2-9388-47a076bfe6da"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:23.102243 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.102221    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2ded43-b4dc-46b2-9388-47a076bfe6da-kube-api-access-9hxkh" (OuterVolumeSpecName: "kube-api-access-9hxkh") pod "ef2ded43-b4dc-46b2-9388-47a076bfe6da" (UID: "ef2ded43-b4dc-46b2-9388-47a076bfe6da"). InnerVolumeSpecName "kube-api-access-9hxkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:23:23.102329 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.102263    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-dshm" (OuterVolumeSpecName: "dshm") pod "ef2ded43-b4dc-46b2-9388-47a076bfe6da" (UID: "ef2ded43-b4dc-46b2-9388-47a076bfe6da"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:23.102329 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.102266    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef2ded43-b4dc-46b2-9388-47a076bfe6da" (UID: "ef2ded43-b4dc-46b2-9388-47a076bfe6da"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:23:23.201999 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.201972    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hxkh\" (UniqueName: \"kubernetes.io/projected/ef2ded43-b4dc-46b2-9388-47a076bfe6da-kube-api-access-9hxkh\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:23.202211 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.202107    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-home\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:23.202211 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.202145    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-model-cache\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:23.202211 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.202160    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-dshm\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:23.202211 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.202174    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tmp-dir\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:23.202211 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.202188    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef2ded43-b4dc-46b2-9388-47a076bfe6da-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:23.397191 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.397153    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"]
Jul 09 19:23:23.399397 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:23.399374    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-4dj2c"]
Jul 09 19:23:24.668794 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:24.668763    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"]
Jul 09 19:23:24.678198 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:23:24.678156    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 19:23:24.678198 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:23:24.678198 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:23:24.678198 ip-10-0-131-205 kubenswrapper[2569]:  > containerID="5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb" cmd=["/bin/sleep","15"]
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:24.678210    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6" message="" err=<
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]:  >
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:23:24.678225    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6" podUID="f86a496f-bef3-4b64-b239-7e154b84eb7f" containerName="main" containerID="cri-o://5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb"
Jul 09 19:23:24.678485 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:24.678277    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6" podUID="f86a496f-bef3-4b64-b239-7e154b84eb7f" containerName="main" containerID="cri-o://5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb" gracePeriod=60
Jul 09 19:23:24.939858 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:24.939824    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:23:25.017040 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.017008    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f86a496f-bef3-4b64-b239-7e154b84eb7f-tokenizer-uds\") pod \"f86a496f-bef3-4b64-b239-7e154b84eb7f\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") "
Jul 09 19:23:25.017040 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.017039    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86a496f-bef3-4b64-b239-7e154b84eb7f-tls-certs\") pod \"f86a496f-bef3-4b64-b239-7e154b84eb7f\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") "
Jul 09 19:23:25.017270 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.017117    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fh7z\" (UniqueName: \"kubernetes.io/projected/f86a496f-bef3-4b64-b239-7e154b84eb7f-kube-api-access-2fh7z\") pod \"f86a496f-bef3-4b64-b239-7e154b84eb7f\" (UID: \"f86a496f-bef3-4b64-b239-7e154b84eb7f\") "
Jul 09 19:23:25.017270 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.017243    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86a496f-bef3-4b64-b239-7e154b84eb7f-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "f86a496f-bef3-4b64-b239-7e154b84eb7f" (UID: "f86a496f-bef3-4b64-b239-7e154b84eb7f"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:25.017393 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.017379    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f86a496f-bef3-4b64-b239-7e154b84eb7f-tokenizer-uds\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:25.019115 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.019090    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f86a496f-bef3-4b64-b239-7e154b84eb7f-kube-api-access-2fh7z" (OuterVolumeSpecName: "kube-api-access-2fh7z") pod "f86a496f-bef3-4b64-b239-7e154b84eb7f" (UID: "f86a496f-bef3-4b64-b239-7e154b84eb7f"). InnerVolumeSpecName "kube-api-access-2fh7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:23:25.019223 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.019179    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f86a496f-bef3-4b64-b239-7e154b84eb7f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f86a496f-bef3-4b64-b239-7e154b84eb7f" (UID: "f86a496f-bef3-4b64-b239-7e154b84eb7f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:23:25.092855 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.092823    2569 generic.go:356] "Generic (PLEG): container finished" podID="f86a496f-bef3-4b64-b239-7e154b84eb7f" containerID="5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb" exitCode=0
Jul 09 19:23:25.093027 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.092873    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"
Jul 09 19:23:25.093027 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.092885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6" event={"ID":"f86a496f-bef3-4b64-b239-7e154b84eb7f","Type":"ContainerDied","Data":"5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb"}
Jul 09 19:23:25.093027 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.092924    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6" event={"ID":"f86a496f-bef3-4b64-b239-7e154b84eb7f","Type":"ContainerDied","Data":"a6313ae6ecad2ab6e42b2cef498b289568271fa53b172332a2a1071db9502614"}
Jul 09 19:23:25.093027 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.092944    2569 scope.go:117] "RemoveContainer" containerID="5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb"
Jul 09 19:23:25.103538 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.103522    2569 scope.go:117] "RemoveContainer" containerID="5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb"
Jul 09 19:23:25.103786 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:23:25.103770    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb\": container with ID starting with 5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb not found: ID does not exist" containerID="5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb"
Jul 09 19:23:25.103835 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.103793    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb"} err="failed to get container status \"5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb\": rpc error: code = NotFound desc = could not find container \"5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb\": container with ID starting with 5d93bfece582d7c697174067cf9be46a158798e62c64d52b4eaca975ac5f25fb not found: ID does not exist"
Jul 09 19:23:25.115926 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.115899    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"]
Jul 09 19:23:25.117808 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.117785    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86a496f-bef3-4b64-b239-7e154b84eb7f-tls-certs\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:25.117808 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.117808    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fh7z\" (UniqueName: \"kubernetes.io/projected/f86a496f-bef3-4b64-b239-7e154b84eb7f-kube-api-access-2fh7z\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:23:25.129973 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.129941    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2ded43-b4dc-46b2-9388-47a076bfe6da" path="/var/lib/kubelet/pods/ef2ded43-b4dc-46b2-9388-47a076bfe6da/volumes"
Jul 09 19:23:25.130267 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:25.130252    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-mh4f6"]
Jul 09 19:23:27.122733 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:27.122689    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f86a496f-bef3-4b64-b239-7e154b84eb7f" path="/var/lib/kubelet/pods/f86a496f-bef3-4b64-b239-7e154b84eb7f/volumes"
Jul 09 19:23:46.622316 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.622275    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"]
Jul 09 19:23:46.622769 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.622690    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2ded43-b4dc-46b2-9388-47a076bfe6da" containerName="main"
Jul 09 19:23:46.622769 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.622701    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2ded43-b4dc-46b2-9388-47a076bfe6da" containerName="main"
Jul 09 19:23:46.622769 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.622722    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f86a496f-bef3-4b64-b239-7e154b84eb7f" containerName="main"
Jul 09 19:23:46.622769 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.622728    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86a496f-bef3-4b64-b239-7e154b84eb7f" containerName="main"
Jul 09 19:23:46.622906 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.622781    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2ded43-b4dc-46b2-9388-47a076bfe6da" containerName="main"
Jul 09 19:23:46.622906 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.622790    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f86a496f-bef3-4b64-b239-7e154b84eb7f" containerName="main"
Jul 09 19:23:46.627151 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.627129    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:46.637050 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.637022    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"]
Jul 09 19:23:46.721988 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.721950    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/064c97ed-2493-4e46-b923-b1da21d1a72f-cert\") pod \"llmisvc-controller-manager-cc9dd9fc5-swxlv\" (UID: \"064c97ed-2493-4e46-b923-b1da21d1a72f\") " pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:46.721988 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.721993    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4v42\" (UniqueName: \"kubernetes.io/projected/064c97ed-2493-4e46-b923-b1da21d1a72f-kube-api-access-m4v42\") pod \"llmisvc-controller-manager-cc9dd9fc5-swxlv\" (UID: \"064c97ed-2493-4e46-b923-b1da21d1a72f\") " pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:46.823379 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.823345    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/064c97ed-2493-4e46-b923-b1da21d1a72f-cert\") pod \"llmisvc-controller-manager-cc9dd9fc5-swxlv\" (UID: \"064c97ed-2493-4e46-b923-b1da21d1a72f\") " pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:46.823379 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.823383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4v42\" (UniqueName: \"kubernetes.io/projected/064c97ed-2493-4e46-b923-b1da21d1a72f-kube-api-access-m4v42\") pod \"llmisvc-controller-manager-cc9dd9fc5-swxlv\" (UID: \"064c97ed-2493-4e46-b923-b1da21d1a72f\") " pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:46.825774 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.825752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/064c97ed-2493-4e46-b923-b1da21d1a72f-cert\") pod \"llmisvc-controller-manager-cc9dd9fc5-swxlv\" (UID: \"064c97ed-2493-4e46-b923-b1da21d1a72f\") " pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:46.832270 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.832246    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4v42\" (UniqueName: \"kubernetes.io/projected/064c97ed-2493-4e46-b923-b1da21d1a72f-kube-api-access-m4v42\") pod \"llmisvc-controller-manager-cc9dd9fc5-swxlv\" (UID: \"064c97ed-2493-4e46-b923-b1da21d1a72f\") " pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:46.938530 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:46.938411    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:47.102501 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:47.102473    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"]
Jul 09 19:23:47.103514 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:23:47.103492    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod064c97ed_2493_4e46_b923_b1da21d1a72f.slice/crio-d5308f2f048d591da0e799ed79a3dd3027ea55ab7617f07df018a10794f8e9bc WatchSource:0}: Error finding container d5308f2f048d591da0e799ed79a3dd3027ea55ab7617f07df018a10794f8e9bc: Status 404 returned error can't find the container with id d5308f2f048d591da0e799ed79a3dd3027ea55ab7617f07df018a10794f8e9bc
Jul 09 19:23:47.230366 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:47.230273    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv" event={"ID":"064c97ed-2493-4e46-b923-b1da21d1a72f","Type":"ContainerStarted","Data":"d5308f2f048d591da0e799ed79a3dd3027ea55ab7617f07df018a10794f8e9bc"}
Jul 09 19:23:48.237309 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:48.237274    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv" event={"ID":"064c97ed-2493-4e46-b923-b1da21d1a72f","Type":"ContainerStarted","Data":"3486ffb823249852ab61703f4fb008f48061bdee863a5e135975d05f6f4b15af"}
Jul 09 19:23:48.237725 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:48.237409    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:23:48.257799 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:23:48.257741    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv" podStartSLOduration=1.7912388940000001 podStartE2EDuration="2.257718083s" totalImagesPullingTime="466.479189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:23:48.255853001 +0000 UTC m=+4749.754909762" watchObservedRunningTime="2026-07-09 19:23:48.257718083 +0000 UTC m=+4749.756774832"
Jul 09 19:24:19.245502 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.245471    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-cc9dd9fc5-swxlv"
Jul 09 19:24:19.291512 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.291482    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"]
Jul 09 19:24:19.291728 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.291701    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq" podUID="3d9fb476-32eb-4156-87f3-6a2448202da0" containerName="manager" containerID="cri-o://8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e" gracePeriod=30
Jul 09 19:24:19.544287 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.544259    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 19:24:19.589655 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.589619    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d9fb476-32eb-4156-87f3-6a2448202da0-cert\") pod \"3d9fb476-32eb-4156-87f3-6a2448202da0\" (UID: \"3d9fb476-32eb-4156-87f3-6a2448202da0\") "
Jul 09 19:24:19.589819 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.589680    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-966b2\" (UniqueName: \"kubernetes.io/projected/3d9fb476-32eb-4156-87f3-6a2448202da0-kube-api-access-966b2\") pod \"3d9fb476-32eb-4156-87f3-6a2448202da0\" (UID: \"3d9fb476-32eb-4156-87f3-6a2448202da0\") "
Jul 09 19:24:19.591708 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.591670    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9fb476-32eb-4156-87f3-6a2448202da0-cert" (OuterVolumeSpecName: "cert") pod "3d9fb476-32eb-4156-87f3-6a2448202da0" (UID: "3d9fb476-32eb-4156-87f3-6a2448202da0"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:24:19.591814 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.591788    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d9fb476-32eb-4156-87f3-6a2448202da0-kube-api-access-966b2" (OuterVolumeSpecName: "kube-api-access-966b2") pod "3d9fb476-32eb-4156-87f3-6a2448202da0" (UID: "3d9fb476-32eb-4156-87f3-6a2448202da0"). InnerVolumeSpecName "kube-api-access-966b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:24:19.690688 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.690658    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-966b2\" (UniqueName: \"kubernetes.io/projected/3d9fb476-32eb-4156-87f3-6a2448202da0-kube-api-access-966b2\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:24:19.690688 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:19.690683    2569 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d9fb476-32eb-4156-87f3-6a2448202da0-cert\") on node \"ip-10-0-131-205.ec2.internal\" DevicePath \"\""
Jul 09 19:24:20.409805 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.409768    2569 generic.go:356] "Generic (PLEG): container finished" podID="3d9fb476-32eb-4156-87f3-6a2448202da0" containerID="8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e" exitCode=0
Jul 09 19:24:20.410248 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.409830    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"
Jul 09 19:24:20.410248 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.409852    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq" event={"ID":"3d9fb476-32eb-4156-87f3-6a2448202da0","Type":"ContainerDied","Data":"8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e"}
Jul 09 19:24:20.410248 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.409912    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq" event={"ID":"3d9fb476-32eb-4156-87f3-6a2448202da0","Type":"ContainerDied","Data":"303644a45e40e27a01c7808dcf944c2b1562d204719cfad5f050dab495c073e4"}
Jul 09 19:24:20.410248 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.409942    2569 scope.go:117] "RemoveContainer" containerID="8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e"
Jul 09 19:24:20.422870 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.422849    2569 scope.go:117] "RemoveContainer" containerID="8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e"
Jul 09 19:24:20.423138 ip-10-0-131-205 kubenswrapper[2569]: E0709 19:24:20.423117    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e\": container with ID starting with 8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e not found: ID does not exist" containerID="8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e"
Jul 09 19:24:20.423221 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.423151    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e"} err="failed to get container status \"8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e\": rpc error: code = NotFound desc = could not find container \"8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e\": container with ID starting with 8b8158b3bdc3a442d5052e7b0af19228399b1909a557dd8033acc7badba48c0e not found: ID does not exist"
Jul 09 19:24:20.434975 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.434950    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"]
Jul 09 19:24:20.438128 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:20.438107    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/llmisvc-controller-manager-74f75ff8c4-wxkhq"]
Jul 09 19:24:21.123423 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:21.123390    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d9fb476-32eb-4156-87f3-6a2448202da0" path="/var/lib/kubelet/pods/3d9fb476-32eb-4156-87f3-6a2448202da0/volumes"
Jul 09 19:24:39.525156 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:39.525007    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:24:39.538545 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:24:39.536633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:28:37.227970 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:37.227935    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:37.233966 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:37.233946    2569 ???:1] "http: TLS handshake error from 10.0.137.79:44106: EOF"
Jul 09 19:28:38.873238 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:38.873207    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:40.495124 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:40.495093    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:42.107526 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:42.107493    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:43.770919 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:43.770889    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:45.388206 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:45.388179    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:46.988849 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:46.988816    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:48.698214 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:48.698179    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:50.472991 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:50.472957    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:52.121206 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:52.121171    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:53.755202 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:53.755170    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:55.359489 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:55.359457    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:56.950764 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:56.950736    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:28:58.546533 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:28:58.546499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:29:00.175647 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:00.175618    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:29:01.787093 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:01.787046    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche9hm9n_39279130-b4d1-4a37-937a-6d88e93dcbaf/main/0.log"
Jul 09 19:29:03.631024 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:03.630991    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q6w6h_c949b3ed-0521-4abf-b8e5-8bdc56e1900b/discovery/0.log"
Jul 09 19:29:03.653688 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:03.653665    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/1.log"
Jul 09 19:29:03.662466 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:03.662446    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/2.log"
Jul 09 19:29:04.985039 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:04.985007    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q6w6h_c949b3ed-0521-4abf-b8e5-8bdc56e1900b/discovery/0.log"
Jul 09 19:29:05.016527 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:05.016498    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/1.log"
Jul 09 19:29:05.025696 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:05.025671    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/2.log"
Jul 09 19:29:06.312902 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:06.312869    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q6w6h_c949b3ed-0521-4abf-b8e5-8bdc56e1900b/discovery/0.log"
Jul 09 19:29:06.341421 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:06.341394    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/1.log"
Jul 09 19:29:06.351276 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:06.351255    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/2.log"
Jul 09 19:29:07.624333 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:07.624301    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q6w6h_c949b3ed-0521-4abf-b8e5-8bdc56e1900b/discovery/0.log"
Jul 09 19:29:07.652645 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:07.652612    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/1.log"
Jul 09 19:29:07.661893 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:07.661869    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/2.log"
Jul 09 19:29:08.651869 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:08.651843    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:08.668451 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:08.668428    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:08.809898 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:08.809871    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:08.820615 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:08.820591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:09.886435 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:09.886409    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:09.900852 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:09.900828    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:10.037210 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:10.037180    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:10.049976 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:10.049951    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:11.103070 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:11.103032    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:11.118504 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:11.118482    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:11.261629 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:11.261594    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:11.271601 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:11.271579    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:12.315718 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:12.315692    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:12.331175 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:12.331152    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:12.472994 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:12.472963    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:12.482819 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:12.482800    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:13.554214 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:13.554189    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:13.578157 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:13.578131    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:13.727971 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:13.727940    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:13.739568 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:13.739545    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:14.896213 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:14.896187    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:14.910506 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:14.910483    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:15.052639 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:15.052607    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:15.062314 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:15.062287    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:16.154868 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:16.154841    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:16.170262 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:16.170234    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:16.313541 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:16.313513    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:16.324746 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:16.324724    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:17.369797 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:17.369770    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:17.384185 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:17.384164    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:17.521688 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:17.521656    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:17.531489 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:17.531462    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:18.590255 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:18.590228    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:18.605749 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:18.605721    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:18.746479 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:18.746450    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:18.756940 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:18.756921    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:19.801528 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:19.801501    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:19.814402 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:19.814378    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:19.964347 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:19.964318    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:19.973478 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:19.973453    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:21.017329 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:21.017292    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:21.033202 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:21.033184    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:21.178747 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:21.178719    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:21.188894 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:21.188874    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:22.255315 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:22.255286    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:22.271231 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:22.271207    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:22.419829 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:22.419795    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:22.430367 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:22.430347    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:23.494993 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:23.494967    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:23.509842 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:23.509817    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:23.648753 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:23.648725    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:23.660835 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:23.660811    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:24.702846 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:24.702819    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:24.719476 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:24.719450    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:24.862736 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:24.862701    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:24.876076 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:24.876033    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:25.931921 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:25.931899    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:25.945467 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:25.945448    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:26.088853 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:26.088822    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:26.098534 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:26.098509    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:27.138846 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:27.138821    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:27.154450 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:27.154426    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:27.298518 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:27.298493    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:27.308390 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:27.308367    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:28.355049 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:28.355024    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:28.371089 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:28.371048    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:28.517529 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:28.517500    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:28.527625 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:28.527600    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:29.564585 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:29.564555    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:29.580522 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:29.580497    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:29.720906 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:29.720861    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:29.730640 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:29.730609    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:30.782307 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:30.782278    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:30.796183 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:30.796160    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:30.935313 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:30.935288    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:30.945600 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:30.945577    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:31.995354 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:31.995330    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:32.010938 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:32.010916    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:32.151688 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:32.151657    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:32.160951 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:32.160929    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:33.233356 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:33.233325    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:33.250854 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:33.250828    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:33.393380 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:33.393354    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:33.403590 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:33.403571    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:36.041085 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.041033    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gxtmp/must-gather-xxptz"]
Jul 09 19:29:36.041483 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.041463    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d9fb476-32eb-4156-87f3-6a2448202da0" containerName="manager"
Jul 09 19:29:36.041483 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.041475    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d9fb476-32eb-4156-87f3-6a2448202da0" containerName="manager"
Jul 09 19:29:36.041555 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.041537    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d9fb476-32eb-4156-87f3-6a2448202da0" containerName="manager"
Jul 09 19:29:36.044735 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.044719    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxtmp/must-gather-xxptz"
Jul 09 19:29:36.047659 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.047632    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gxtmp\"/\"openshift-service-ca.crt\""
Jul 09 19:29:36.047795 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.047709    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gxtmp\"/\"default-dockercfg-vf5cc\""
Jul 09 19:29:36.048974 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.048956    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gxtmp\"/\"kube-root-ca.crt\""
Jul 09 19:29:36.055448 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.055426    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxtmp/must-gather-xxptz"]
Jul 09 19:29:36.155664 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.155636    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgl9w\" (UniqueName: \"kubernetes.io/projected/90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82-kube-api-access-kgl9w\") pod \"must-gather-xxptz\" (UID: \"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82\") " pod="openshift-must-gather-gxtmp/must-gather-xxptz"
Jul 09 19:29:36.155833 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.155762    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82-must-gather-output\") pod \"must-gather-xxptz\" (UID: \"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82\") " pod="openshift-must-gather-gxtmp/must-gather-xxptz"
Jul 09 19:29:36.256531 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.256494    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgl9w\" (UniqueName: \"kubernetes.io/projected/90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82-kube-api-access-kgl9w\") pod \"must-gather-xxptz\" (UID: \"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82\") " pod="openshift-must-gather-gxtmp/must-gather-xxptz"
Jul 09 19:29:36.256720 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.256595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82-must-gather-output\") pod \"must-gather-xxptz\" (UID: \"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82\") " pod="openshift-must-gather-gxtmp/must-gather-xxptz"
Jul 09 19:29:36.256931 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.256910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82-must-gather-output\") pod \"must-gather-xxptz\" (UID: \"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82\") " pod="openshift-must-gather-gxtmp/must-gather-xxptz"
Jul 09 19:29:36.264630 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.264602    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgl9w\" (UniqueName: \"kubernetes.io/projected/90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82-kube-api-access-kgl9w\") pod \"must-gather-xxptz\" (UID: \"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82\") " pod="openshift-must-gather-gxtmp/must-gather-xxptz"
Jul 09 19:29:36.369137 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.369104    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxtmp/must-gather-xxptz"
Jul 09 19:29:36.501232 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.501164    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxtmp/must-gather-xxptz"]
Jul 09 19:29:36.503870 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:29:36.503842    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90eeffd2_bcad_4ee2_8c53_14d4c9bc6e82.slice/crio-c9e762a3aeb7f459c432bc3ce05c27c2a5eece0400571d834c1bcb2b7e8be25c WatchSource:0}: Error finding container c9e762a3aeb7f459c432bc3ce05c27c2a5eece0400571d834c1bcb2b7e8be25c: Status 404 returned error can't find the container with id c9e762a3aeb7f459c432bc3ce05c27c2a5eece0400571d834c1bcb2b7e8be25c
Jul 09 19:29:36.506076 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:36.506042    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:29:37.179279 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:37.179242    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxtmp/must-gather-xxptz" event={"ID":"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82","Type":"ContainerStarted","Data":"c9e762a3aeb7f459c432bc3ce05c27c2a5eece0400571d834c1bcb2b7e8be25c"}
Jul 09 19:29:38.190765 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:38.190727    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxtmp/must-gather-xxptz" event={"ID":"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82","Type":"ContainerStarted","Data":"65133d3f421dd587d54e5d11ff67427cbd227392dff9cf93b16c536348f94242"}
Jul 09 19:29:38.191282 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:38.190780    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxtmp/must-gather-xxptz" event={"ID":"90eeffd2-bcad-4ee2-8c53-14d4c9bc6e82","Type":"ContainerStarted","Data":"11560f589f79e66cf5894110783fd0a9316bac9414bac046a42da1200609cd51"}
Jul 09 19:29:38.212392 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:38.212339    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gxtmp/must-gather-xxptz" podStartSLOduration=1.221762989 podStartE2EDuration="2.212319594s" totalImagesPullingTime="990.556605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:29:38.208875788 +0000 UTC m=+5099.707932535" watchObservedRunningTime="2026-07-09 19:29:38.212319594 +0000 UTC m=+5099.711376345"
Jul 09 19:29:39.097780 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:39.097755    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pszsp_d8ab92ab-b3bb-4440-a0a2-39c193c64a15/global-pull-secret-syncer/0.log"
Jul 09 19:29:39.182665 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:39.182631    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cwk5m_8cbbf4c1-03c9-4f5c-9fd3-cbe556ab686a/konnectivity-agent/0.log"
Jul 09 19:29:39.292481 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:39.292453    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-205.ec2.internal_7bc21c147e1940ae7b527f63edb824e1/haproxy/0.log"
Jul 09 19:29:39.584497 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:39.584467    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:29:39.594890 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:39.594683    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhbzn_6572fa80-150a-46a3-b8e6-cf50e2ad9d13/ovn-acl-logging/0.log"
Jul 09 19:29:43.715171 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:43.715135    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-586ks_6991c4b5-7992-4b82-8f55-2bb84422dbba/manager/0.log"
Jul 09 19:29:43.742879 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:43.742842    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-vckrl_02100c7b-b225-4c38-9549-e00493058a7a/manager/0.log"
Jul 09 19:29:43.965084 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:43.962434    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-nws8x_9d85a840-b46c-4c6f-a363-79c65aee2797/manager/0.log"
Jul 09 19:29:43.990139 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:43.989939    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-prlh5_7f7f995d-90bb-4baf-a7d7-ecc20d8297d8/limitador/0.log"
Jul 09 19:29:45.433028 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.432966    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3adbbb95-20b9-4b9e-8985-aabd8d9e78f2/alertmanager/0.log"
Jul 09 19:29:45.462972 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.462943    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3adbbb95-20b9-4b9e-8985-aabd8d9e78f2/config-reloader/0.log"
Jul 09 19:29:45.488196 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.488164    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3adbbb95-20b9-4b9e-8985-aabd8d9e78f2/kube-rbac-proxy-web/0.log"
Jul 09 19:29:45.513989 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.513954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3adbbb95-20b9-4b9e-8985-aabd8d9e78f2/kube-rbac-proxy/0.log"
Jul 09 19:29:45.537477 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.537440    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3adbbb95-20b9-4b9e-8985-aabd8d9e78f2/kube-rbac-proxy-metric/0.log"
Jul 09 19:29:45.561838 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.561807    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3adbbb95-20b9-4b9e-8985-aabd8d9e78f2/prom-label-proxy/0.log"
Jul 09 19:29:45.589147 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.589114    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3adbbb95-20b9-4b9e-8985-aabd8d9e78f2/init-config-reloader/0.log"
Jul 09 19:29:45.739419 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.739341    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55df8d4f4b-xmg75_14ea66fb-ecd1-4b41-959a-46a6d852b5d5/metrics-server/0.log"
Jul 09 19:29:45.877401 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.877375    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jmts9_10fbd32c-45c3-4550-9e55-434964c2abb1/node-exporter/0.log"
Jul 09 19:29:45.899434 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.899407    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jmts9_10fbd32c-45c3-4550-9e55-434964c2abb1/kube-rbac-proxy/0.log"
Jul 09 19:29:45.922400 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:45.922379    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jmts9_10fbd32c-45c3-4550-9e55-434964c2abb1/init-textfile/0.log"
Jul 09 19:29:46.038222 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.038144    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wdxbc_460e28c1-334c-4166-b027-6e2e0a36ab12/kube-rbac-proxy-main/0.log"
Jul 09 19:29:46.062209 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.062185    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wdxbc_460e28c1-334c-4166-b027-6e2e0a36ab12/kube-rbac-proxy-self/0.log"
Jul 09 19:29:46.089115 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.088941    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-wdxbc_460e28c1-334c-4166-b027-6e2e0a36ab12/openshift-state-metrics/0.log"
Jul 09 19:29:46.345520 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.345493    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-sbpjx_e4769445-44d5-4fdf-9411-c040580bc87b/prometheus-operator/0.log"
Jul 09 19:29:46.380432 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.380405    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-sbpjx_e4769445-44d5-4fdf-9411-c040580bc87b/kube-rbac-proxy/0.log"
Jul 09 19:29:46.410554 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.410517    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-jq4kw_5b03893c-e8e5-493c-a403-356658f5242a/prometheus-operator-admission-webhook/0.log"
Jul 09 19:29:46.566887 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.566863    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7d9f746d-7rmgc_7bd9446a-9e90-4bab-b656-a39d994d30a3/thanos-query/0.log"
Jul 09 19:29:46.593531 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.593492    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7d9f746d-7rmgc_7bd9446a-9e90-4bab-b656-a39d994d30a3/kube-rbac-proxy-web/0.log"
Jul 09 19:29:46.621417 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.621331    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7d9f746d-7rmgc_7bd9446a-9e90-4bab-b656-a39d994d30a3/kube-rbac-proxy/0.log"
Jul 09 19:29:46.643893 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.643858    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7d9f746d-7rmgc_7bd9446a-9e90-4bab-b656-a39d994d30a3/prom-label-proxy/0.log"
Jul 09 19:29:46.673416 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.673389    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7d9f746d-7rmgc_7bd9446a-9e90-4bab-b656-a39d994d30a3/kube-rbac-proxy-rules/0.log"
Jul 09 19:29:46.699397 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:46.699364    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7d9f746d-7rmgc_7bd9446a-9e90-4bab-b656-a39d994d30a3/kube-rbac-proxy-metrics/0.log"
Jul 09 19:29:49.146755 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.146727    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ccc5db49f-vthh4_bd53f15f-139c-4505-96ac-9d8812fe922a/console/0.log"
Jul 09 19:29:49.436005 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.435925    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"]
Jul 09 19:29:49.440155 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.440133    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.448091 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.448037    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"]
Jul 09 19:29:49.603529 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.603498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7wwc\" (UniqueName: \"kubernetes.io/projected/fa5bf3ce-c956-4155-bf79-91e8adab2866-kube-api-access-h7wwc\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.603529 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.603542    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-proc\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.603753 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.603616    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-sys\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.603753 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.603695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-podres\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.603825 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.603760    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-lib-modules\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.704985 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.704899    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-sys\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.705269 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.705250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-podres\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.705428 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.705409    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-lib-modules\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.705543 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.705516    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-lib-modules\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.705745 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.705630    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7wwc\" (UniqueName: \"kubernetes.io/projected/fa5bf3ce-c956-4155-bf79-91e8adab2866-kube-api-access-h7wwc\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.706337 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.705180    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-sys\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.707028 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.706852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-proc\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.707028 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.706990    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-podres\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.711071 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.707724    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa5bf3ce-c956-4155-bf79-91e8adab2866-proc\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.715707 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.715169    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7wwc\" (UniqueName: \"kubernetes.io/projected/fa5bf3ce-c956-4155-bf79-91e8adab2866-kube-api-access-h7wwc\") pod \"perf-node-gather-daemonset-jdqbp\" (UID: \"fa5bf3ce-c956-4155-bf79-91e8adab2866\") " pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.755422 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.755380    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:49.939825 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:49.939750    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"]
Jul 09 19:29:49.947710 ip-10-0-131-205 kubenswrapper[2569]: W0709 19:29:49.946123    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa5bf3ce_c956_4155_bf79_91e8adab2866.slice/crio-08e43fd057e3de74ca06f9ed19655498e7c2eacd58f1ff53dc307a616495d172 WatchSource:0}: Error finding container 08e43fd057e3de74ca06f9ed19655498e7c2eacd58f1ff53dc307a616495d172: Status 404 returned error can't find the container with id 08e43fd057e3de74ca06f9ed19655498e7c2eacd58f1ff53dc307a616495d172
Jul 09 19:29:50.318854 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:50.318664    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp" event={"ID":"fa5bf3ce-c956-4155-bf79-91e8adab2866","Type":"ContainerStarted","Data":"0671a3eb1f479288a0ce1b1bfd8e54c74cd054ccddcba6fdd27d4decbf39b24d"}
Jul 09 19:29:50.319331 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:50.318937    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:50.319331 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:50.318982    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp" event={"ID":"fa5bf3ce-c956-4155-bf79-91e8adab2866","Type":"ContainerStarted","Data":"08e43fd057e3de74ca06f9ed19655498e7c2eacd58f1ff53dc307a616495d172"}
Jul 09 19:29:50.340720 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:50.340669    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp" podStartSLOduration=1.340655238 podStartE2EDuration="1.340655238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:29:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:29:50.339153499 +0000 UTC m=+5111.838210248" watchObservedRunningTime="2026-07-09 19:29:50.340655238 +0000 UTC m=+5111.839712020"
Jul 09 19:29:51.026656 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:51.026632    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9lzn_0acb8592-4eba-439a-97fc-189710a23316/dns/0.log"
Jul 09 19:29:51.047716 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:51.047692    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9lzn_0acb8592-4eba-439a-97fc-189710a23316/kube-rbac-proxy/0.log"
Jul 09 19:29:51.098971 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:51.098938    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52r8t_d2c30535-1255-4b1f-9e87-5c146bfd3088/dns-node-resolver/0.log"
Jul 09 19:29:51.737638 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:51.737602    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mx7g4_e3f6f546-6c19-4bd6-89f6-5b049cad7bde/node-ca/0.log"
Jul 09 19:29:53.212987 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:53.212951    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q6w6h_c949b3ed-0521-4abf-b8e5-8bdc56e1900b/discovery/0.log"
Jul 09 19:29:53.249726 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:53.249699    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/1.log"
Jul 09 19:29:53.261881 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:53.261859    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/2.log"
Jul 09 19:29:53.868476 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:53.868452    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tx2nj_33409e0d-4142-4dbe-abab-eb283eee9edc/serve-healthcheck-canary/0.log"
Jul 09 19:29:54.534579 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:54.534547    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hm7gs_6859cd39-155a-4995-8555-ca166ee428f3/kube-rbac-proxy/0.log"
Jul 09 19:29:54.574273 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:54.574250    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hm7gs_6859cd39-155a-4995-8555-ca166ee428f3/exporter/0.log"
Jul 09 19:29:54.597356 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:54.597326    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hm7gs_6859cd39-155a-4995-8555-ca166ee428f3/extractor/0.log"
Jul 09 19:29:57.343871 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:57.343841    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gxtmp/perf-node-gather-daemonset-jdqbp"
Jul 09 19:29:58.198966 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:58.198938    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-57b57d8c6-jffg6_4236e806-ccef-486f-ae02-6f5802ff20d0/manager/0.log"
Jul 09 19:29:58.255821 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:58.255767    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-cc9dd9fc5-swxlv_064c97ed-2493-4e46-b923-b1da21d1a72f/manager/0.log"
Jul 09 19:29:58.882363 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:29:58.882272    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-dwwvf_bc7e0dd7-f664-44cc-9147-a14e91bf87bf/seaweedfs/0.log"
Jul 09 19:30:00.923217 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:00.922975    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q6w6h_c949b3ed-0521-4abf-b8e5-8bdc56e1900b/discovery/0.log"
Jul 09 19:30:00.960498 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:00.960000    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/1.log"
Jul 09 19:30:00.975862 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:00.975831    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/2.log"
Jul 09 19:30:02.576862 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:02.576801    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q6w6h_c949b3ed-0521-4abf-b8e5-8bdc56e1900b/discovery/0.log"
Jul 09 19:30:02.619615 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:02.619582    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/1.log"
Jul 09 19:30:02.634354 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:02.634322    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-p4tn9_fb8342bd-81ef-451a-81a1-8f8fe26e6108/istio-proxy/2.log"
Jul 09 19:30:06.091159 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.091114    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5n5wn_c5d4b889-895b-4c71-a943-85aae52800fe/kube-multus/0.log"
Jul 09 19:30:06.146152 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.146128    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4vs42_722305f7-f162-451c-809a-301a9fc7b0b4/kube-multus-additional-cni-plugins/0.log"
Jul 09 19:30:06.170126 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.170101    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4vs42_722305f7-f162-451c-809a-301a9fc7b0b4/egress-router-binary-copy/0.log"
Jul 09 19:30:06.194636 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.194611    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4vs42_722305f7-f162-451c-809a-301a9fc7b0b4/cni-plugins/0.log"
Jul 09 19:30:06.218307 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.218252    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4vs42_722305f7-f162-451c-809a-301a9fc7b0b4/bond-cni-plugin/0.log"
Jul 09 19:30:06.244779 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.244759    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4vs42_722305f7-f162-451c-809a-301a9fc7b0b4/routeoverride-cni/0.log"
Jul 09 19:30:06.269241 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.269221    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4vs42_722305f7-f162-451c-809a-301a9fc7b0b4/whereabouts-cni-bincopy/0.log"
Jul 09 19:30:06.292223 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.292203    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4vs42_722305f7-f162-451c-809a-301a9fc7b0b4/whereabouts-cni/0.log"
Jul 09 19:30:06.779544 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.779510    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-msmqp_bcf7e722-8a18-4a9c-9a03-b8033505fc4e/network-metrics-daemon/0.log"
Jul 09 19:30:06.800285 ip-10-0-131-205 kubenswrapper[2569]: I0709 19:30:06.800255    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-msmqp_bcf7e722-8a18-4a9c-9a03-b8033505fc4e/kube-rbac-proxy/0.log"